00000001:02000400:0.0F:1788864637.447355:0:2956:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1788864653.596649:0:3177:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1788864655.114961:0:3219:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 843 MB/s 00000001:01000000:3.0F:1788864655.365109:0:3219:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 531 MB/s 00000001:01000000:2.0F:1788864655.614766:0:3219:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 8475 MB/s 00000020:02000000:2.0:1788864656.272483:0:3269:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_g331ba7d 00000400:02000000:0.0:1788864657.122604:0:3284:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.113@tcp [8/256/0/180] 00008000:02000000:3.0:1788864660.657456:0:3433:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788864716.286445:0:5239:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788864724.463672:0:5816:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788864724.463678:0:5816:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788864724.463941:0:5816:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000ce42f5c9 00000080:02000400:1.0:1788864724.463954:0:5816:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788864724.473635:0:5816:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788864724.473649:0:5816:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788864724.474258:0:5816:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000e7b2e41d) 00000020:00000080:0.0:1788864724.474276:0:5816:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788864724.511177:0:5816:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788864724.511633:0:5816:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788864724.547526:0:5816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788864724.547568:0:5816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788864724.547590:0:5816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788864724.547637:0:5816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788864724.547662:0:5816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788864724.548546:0:5816:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788864724.548554:0:5816:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788864724.548564:0:5816:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf8c13e2d0e958e9b 00000020:01000004:2.0:1788864724.548572:0:5816:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788864724.548577:0:5816:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788864724.548581:0:5816:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ce42f5c9 from MGS 00000020:01000004:2.0:1788864724.548585:0:5816:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788864724.548603:0:5816:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000043aee935) 00000020:00000080:2.0:1788864724.548614:0:5816:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788864724.548812:0:5816:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ce42f5c9 from MGS, refs=2 00080000:01000000:2.0:1788864724.548818:0:5816:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788864724.548824:0:5816:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf8c13e2d0e958ea9 00000100:00100000:2.0:1788864724.548985:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788864724.551613:0:5816:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788864724.551628:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788864724.552523:0:5816:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788864724.552531:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788864724.553773:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788864724.554011:0:5816:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788864724.554214:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788864724.555862:0:5816:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788864724.555941:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788864724.556537:0:5816:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788864724.556548:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788864724.557641:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864724.557646:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864724.557647:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864724.558369:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864724.558372:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864724.558374:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864724.559339:0:5816:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788864724.561344:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1788864724.808850:0:5816:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3147 MB/s 00000001:01000000:2.0:1788864725.058840:0:5816:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3391 MB/s 00000001:01000000:2.0:1788864725.309003:0:5816:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 627 MB/s 00000001:01000000:3.0:1788864725.561628:0:5816:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1055 MB/s 00080000:10000000:3.0:1788864725.574687:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:0.0:1788864725.574773:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788864725.590697:0:5816:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788864725.590737:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788864725.590740:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788864725.591651:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788864725.591766:0:5816:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788864725.591945:0:5816:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788864725.592302:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788864725.593432:0:5816:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788864725.594145:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788864725.595332:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788864725.595343:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788864725.596241:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788864725.596249:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788864725.602416:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788864725.602431:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788864725.603567:0:5816:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788864725.603588:0:5816:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.113@tcp' 00000020:01000004:3.0:1788864725.603590:0:5816:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788864725.603642:0:5816:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.113@tcp (typ=mgc) 00000020:00000080:3.0:1788864725.603660:0:5816:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.113@tcp (00000000ed3c5658) 00000020:00000080:3.0:1788864725.603677:0:5816:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788864725.603827:0:5816:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000062022319@MGC192.168.203.113@tcp: add connection 192.168.203.113@tcp at head 00010000:00010000:3.0:1788864725.603978:0:5816:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.113@tcp-0 is initialized 00000040:01000000:3.0:1788864725.603985:0:5816:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788864725.606353:0:5831:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788864725.607699:0:5832:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788864725.607760:0:5816:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.113@tcp (uuid ad9c839d-b0de-4595-ae42-0c3c3a7e2f96) 00000020:00000080:3.0:1788864725.607782:0:5816:0:(genops.c:1384:class_connect()) connect: client ad9c839d-b0de-4595-ae42-0c3c3a7e2f96, cookie 0xf8c13e2d0e958eb7 00000100:00080000:3.0:1788864725.607795:0:5816:0:(import.c:545:import_select_connection()) MGC192.168.203.113@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788864725.607820:0:5816:0:(import.c:666:import_select_connection()) MGC192.168.203.113@tcp: import 0000000062022319 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788864725.608018:0:5816:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000005a509ea x1875760546578560/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788864725.608038:0:5816:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ad9c839d-b0de-4595-ae42-0c3c3a7e2f96->MGS 00000020:01000004:3.0:1788864725.608070:0:5816:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788864725.608089:0:5816:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788864725.608100:0:5816:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000004893fbcd) 00000020:00000080:3.0:1788864725.608112:0:5816:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788864725.608413:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000005a509ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3299:1875760546578560:0@lo:250: 00000100:00100000:2.0:1788864725.608489:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864725.608551:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546578560 00000100:00100000:2.0:1788864725.608558:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546578560 00000100:00100000:2.0:1788864725.610588:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788864725.610599:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000da8bb176 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3299:x1875760546578560:12345-0@lo:250: 00010000:00080000:2.0:1788864725.610630:0:5827:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from ad9c839d-b0de-4595-ae42-0c3c3a7e2f96@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:2.0:1788864725.610661:0:5827:0:(genops.c:1384:class_connect()) connect: client ad9c839d-b0de-4595-ae42-0c3c3a7e2f96, cookie 0xf8c13e2d0e958ec5 00000100:00080000:2.0:1788864725.610855:0:5827:0:(import.c:65:import_set_state_nolock()) 00000000d4fb2088 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788864725.610943:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000da8bb176 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+5:3299:x1875760546578560:12345-0@lo:250: Request processed in 344us (2455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864725.610952:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788864725.611642:0:3299:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.113@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788864725.611653:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.113@tcp: connect to target with instance 0 00000100:00080000:2.0:1788864725.611661:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.113@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788864725.611666:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788864725.611669:0:3299:0:(import.c:65:import_set_state_nolock()) 0000000062022319 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788864725.611671:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788864725.611682:0:3299:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788864725.611688:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000005a509ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3299:1875760546578560:0@lo:250: 00000100:00100000:2.0:1788864725.622979:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788864725.626213:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788864725.626225:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788864725.628126:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788864725.628139:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788864725.629151:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788864725.629171:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788864725.630677:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788864725.630902:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788864725.630908:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788864725.636054:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788864725.636067:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788864725.691635:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788864725.692089:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788864725.692095:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788864725.694150:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788864725.694173:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788864725.695106:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788864725.695296:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788864725.695302:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788864725.696206:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788864725.696215:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788864725.697080:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788864725.697579:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788864725.697585:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788864725.698537:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788864725.698546:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788864725.699538:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788864725.699964:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788864725.699970:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788864725.701927:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788864725.702006:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788864725.745110:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788864725.745350:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788864725.745356:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788864725.746553:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788864725.746562:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788864725.748146:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788864725.748167:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788864725.748926:0:5816:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788864725.748949:0:5816:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788864725.748956:0:5816:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788864725.749096:0:5816:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788864725.749126:0:5816:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788864725.749130:0:5816:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788864725.749132:0:5816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788864725.749134:0:5816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788864725.749135:0:5816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788864725.749136:0:5816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788864725.749137:0:5816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788864725.749138:0:5816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788864725.749139:0:5816:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788864725.749140:0:5816:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788864725.749142:0:5816:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788864725.749143:0:5816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788864725.749144:0:5816:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788864725.749146:0:5816:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788864725.749148:0:5816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788864725.749149:0:5816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788864725.749150:0:5816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788864725.749151:0:5816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788864725.749152:0:5816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788864725.749153:0:5816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788864725.749154:0:5816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788864725.749155:0:5816:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788864725.749156:0:5816:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788864725.749157:0:5816:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788864725.749167:0:5816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788864725.749174:0:5816:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788864725.749204:0:5816:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788864725.749221:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e929d1c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546578688:0@lo:253: 00000100:00100000:1.0:1788864725.749297:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864725.749396:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b0c2872 going to sleep for 11 seconds 00000100:00100000:2.0:1788864725.749498:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546578688 00000100:00100000:2.0:1788864725.749507:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546578688 00000100:00100000:2.0:1788864725.749587:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788864725.749596:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d8106f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+5:5816:x1875760546578688:12345-0@lo:253: 20000000:01000000:2.0:1788864725.749641:0:5830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788864725.749644:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788864725.750126:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788864725.750188:0:5830:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788864725.750463:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788864725.751431:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788864725.751661:0:5830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788864725.751666:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788864725.751671:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788864725.751674:0:5830:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788864725.751688:0:5830:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788864725.752004:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788864725.752267:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788864725.752280:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788864725.752334:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788864725.752376:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788864725.752403:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788864725.752478:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788864725.752485:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788864725.752520:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788864725.752526:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788864725.752551:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788864725.752557:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788864725.752586:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788864725.752634:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788864725.752662:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788864725.752667:0:5830:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788864725.752680:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788864725.753217:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788864725.753230:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788864725.753269:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788864725.753302:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788864725.753363:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788864725.753377:0:5830:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788864725.753462:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788864725.753470:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788864725.753509:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788864725.753540:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788864725.753567:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788864725.753577:0:5830:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788864725.753670:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788864725.753679:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788864725.757354:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788864725.757439:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788864725.757649:0:5830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788864725.757693:0:5830:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788864725.757723:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788864725.758264:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788864725.758546:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788864725.758574:0:5830:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.113@tcp for mdt 20000000:01000000:3.0:1788864725.758577:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:3.0:1788864725.758613:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788864725.758622:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788864725.758653:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788864725.758661:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:3.0:1788864725.758741:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788864725.758753:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788864725.758787:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788864725.758830:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788864725.758891:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788864725.758902:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788864725.758906:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788864725.758918:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788864725.758921:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788864725.758950:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788864725.758952:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788864725.759448:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1788864725.759647:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788864725.759686:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1788864725.759911:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1788864725.759927:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788864725.759929:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788864725.760352:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788864725.760566:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788864725.760606:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788864725.760641:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1788864725.760654:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788864725.760656:0:5830:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1788864725.760661:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788864725.760663:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788864725.760668:0:5830:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788864725.760674:0:5830:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788864725.761280:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788864725.761425:0:5830:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788864725.780413:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788864725.780473:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788864725.780576:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788864725.780601:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788864725.780622:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fd657d99/0xf8c13e2d0e958ecc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864725.780638:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fd657d99/0xf8c13e2d0e958ecc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864725.780648:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fd657d99/0xf8c13e2d0e958ecc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864725.780654:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fd657d99/0xf8c13e2d0e958ecc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864725.780660:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fd657d99/0xf8c13e2d0e958ecc lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864725.781524:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fd657d99/0xf8c13e2d0e958ecc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864725.781532:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fd657d99 already unused, calling callback (00000000a9328086) 00010000:00010000:3.0:1788864725.781546:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fd657d99/0xf8c13e2d0e958ecc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864725.781553:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fd657d99/0xf8c13e2d0e958ecc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864725.781566:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fd657d99/0xf8c13e2d0e958ecc lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864725.781573:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fd657d99/0xf8c13e2d0e958ecc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864725.781579:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fd657d99/0xf8c13e2d0e958ecc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788864725.781599:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788864726.021926:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d8106f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+5:5816:x1875760546578688:12345-0@lo:253: Request processed in 272323us (272621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864726.021942:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788864726.026262:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e929d1c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546578688:0@lo:253: 10000000:01000000:1.0:1788864726.026284:0:5816:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788864726.026288:0:5816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788864726.026290:0:5816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788864726.026291:0:5816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788864726.026293:0:5816:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788864726.026294:0:5816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788864726.026295:0:5816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788864726.026296:0:5816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788864726.026298:0:5816:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788864726.026299:0:5816:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788864726.026301:0:5816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788864726.026302:0:5816:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788864726.026325:0:5816:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ce42f5c9 from lustre-MDT0000 10000000:01000000:1.0:1788864726.026352:0:5816:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788864726.026356:0:5816:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788864726.026360:0:5816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9fdca1ff4d40 10000000:01000000:1.0:1788864726.026364:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788864726.026372:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fdca1ff4d40 from 1 10000000:01000000:1.0:1788864726.026375:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788864726.026424:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000f44eb64d/0xf8c13e2d0e958ed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.026435:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000f44eb64d/0xf8c13e2d0e958ed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.026463:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000f44eb64d/0xf8c13e2d0e958ed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864726.026482:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e929d1c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546578816:0@lo:101: 00000100:00100000:1.0:1788864726.026541:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864726.026659:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 000000006651627b going to sleep for 11 seconds 00000100:00100000:3.0:1788864726.033238:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546578816 00000100:00100000:3.0:1788864726.033253:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546578816 00000100:00100000:3.0:1788864726.033320:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788864726.033328:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000098f98360 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+5:5816:x1875760546578816:12345-0@lo:101: 00010000:00010000:3.0:1788864726.033346:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864726.033363:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fd657d99/0xf8c13e2d0e958eda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e958ed3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864726.033390:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fd657d99/0xf8c13e2d0e958eda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e958ed3 expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864726.033400:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fd657d99/0xf8c13e2d0e958eda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e958ed3 expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864726.033420:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fd657d99, rc 0) 00000100:00100000:3.0:1788864726.033513:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000098f98360 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+6:5816:x1875760546578816:12345-0@lo:101: Request processed in 185us (6973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864726.033520:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788864726.033752:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e929d1c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546578816:0@lo:101: 00010000:00010000:1.0:1788864726.033771:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000f44eb64d/0xf8c13e2d0e958ed3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958eda expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.033780:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000f44eb64d/0xf8c13e2d0e958ed3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e958eda expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864726.033846:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e929d1c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546578944:0@lo:501: 00000100:00100000:1.0:1788864726.033879:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864726.033929:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 000000006651627b going to sleep for 11 seconds 00000100:00100000:2.0:1788864726.034004:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546578944 00000100:00100000:2.0:1788864726.034009:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546578944 00000100:00100000:2.0:1788864726.034035:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788864726.034042:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000206dd646 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+6:5816:x1875760546578944:12345-0@lo:501: 00000100:00100000:2.0:1788864726.034278:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000206dd646 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+6:5816:x1875760546578944:12345-0@lo:501: Request processed in 237us (398us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788864726.034286:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788864726.034492:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e929d1c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546578944:0@lo:501: 10000000:01000000:1.0:1788864726.034530:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788864726.034546:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000f44eb64d/0xf8c13e2d0e958ed3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958eda expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.034554:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000f44eb64d/0xf8c13e2d0e958ed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958eda expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788864726.034571:0:5816:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fdc8878e000 10000000:01000000:1.0:1788864726.034577:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788864726.034588:0:5816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fdc8878e000 10000000:01000000:1.0:1788864726.034592:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788864726.034595:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fdc8878e000 from 1 10000000:01000000:1.0:1788864726.034597:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788864726.034619:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 0000000024be859c/0xf8c13e2d0e958ee1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.034626:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 0000000024be859c/0xf8c13e2d0e958ee1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.034634:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 0000000024be859c/0xf8c13e2d0e958ee1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864726.034646:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e929d1c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546579072:0@lo:101: 00000100:00100000:1.0:1788864726.034675:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864726.034697:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 000000006651627b going to sleep for 11 seconds 00000100:00100000:0.0:1788864726.034774:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546579072 00000100:00100000:0.0:1788864726.034780:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546579072 00000100:00100000:0.0:1788864726.034815:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788864726.034822:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000138927e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+6:5816:x1875760546579072:12345-0@lo:101: 00010000:00010000:0.0:1788864726.034830:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864726.034840:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002310e85e/0xf8c13e2d0e958ee8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e958ee1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864726.034857:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002310e85e/0xf8c13e2d0e958ee8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e958ee1 expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864726.034865:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002310e85e/0xf8c13e2d0e958ee8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e958ee1 expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864726.034878:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002310e85e, rc 0) 00000100:00100000:0.0:1788864726.034937:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000138927e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+7:5816:x1875760546579072:12345-0@lo:101: Request processed in 115us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864726.034943:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788864726.035136:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e929d1c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546579072:0@lo:101: 00010000:00010000:1.0:1788864726.035147:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 0000000024be859c/0xf8c13e2d0e958ee1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958ee8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.035154:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 0000000024be859c/0xf8c13e2d0e958ee1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e958ee8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788864726.035176:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788864726.035188:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 0000000024be859c/0xf8c13e2d0e958ee1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958ee8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.035195:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 0000000024be859c/0xf8c13e2d0e958ee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958ee8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788864726.035212:0:5816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788864726.035215:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788864726.035219:0:5816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fdc8878e000 10000000:01000000:1.0:1788864726.035221:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788864726.035224:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788864726.035226:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788864726.035240:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 000000004eae6753/0xf8c13e2d0e958eef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.035246:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 000000004eae6753/0xf8c13e2d0e958eef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.035252:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 000000004eae6753/0xf8c13e2d0e958eef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864726.035263:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e929d1c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546579200:0@lo:101: 00000100:00100000:1.0:1788864726.035289:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864726.035312:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 000000006651627b going to sleep for 11 seconds 00000100:00100000:1.0:1788864726.035329:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546579200 00000100:00100000:1.0:1788864726.035333:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546579200 00000100:00100000:1.0:1788864726.035373:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788864726.035380:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000613c4987 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+7:5816:x1875760546579200:12345-0@lo:101: 00010000:00010000:1.0:1788864726.035387:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864726.035395:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008c9c7da3/0xf8c13e2d0e958ef6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e958eef expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.035422:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008c9c7da3/0xf8c13e2d0e958ef6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e958eef expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.035441:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008c9c7da3/0xf8c13e2d0e958ef6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e958eef expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.035448:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008c9c7da3, rc 0) 00000100:00100000:1.0:1788864726.035477:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000613c4987 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+8:5816:x1875760546579200:12345-0@lo:101: Request processed in 98us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864726.035483:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788864726.035514:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e929d1c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546579200:0@lo:101: 00010000:00010000:1.0:1788864726.035522:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 000000004eae6753/0xf8c13e2d0e958eef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958ef6 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.035529:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 000000004eae6753/0xf8c13e2d0e958eef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e958ef6 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864726.035565:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e929d1c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546579328:0@lo:501: 00000100:00100000:1.0:1788864726.035587:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864726.035599:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 000000006651627b going to sleep for 11 seconds 00000100:00100000:1.0:1788864726.035611:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546579328 00000100:00100000:1.0:1788864726.035615:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546579328 00000100:00100000:1.0:1788864726.035637:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788864726.035642:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000013020948 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+8:5816:x1875760546579328:12345-0@lo:501: 00000100:00100000:1.0:1788864726.036180:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000013020948 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+9:5816:x1875760546579328:12345-0@lo:501: Request processed in 537us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864726.036188:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788864726.036529:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e929d1c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546579328:0@lo:501: 00000100:00100000:0.0:1788864726.036579:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064f01ac1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546579456:0@lo:503: 00000100:00100000:0.0:1788864726.036621:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864726.036689:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 00000000761f32fc going to sleep for 11 seconds 00000100:00100000:3.0:1788864726.036764:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546579456 00000100:00100000:3.0:1788864726.036770:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546579456 00000100:00100000:3.0:1788864726.036834:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788864726.036842:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002bb72922 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+9:5816:x1875760546579456:12345-0@lo:503: 00000100:00100000:3.0:1788864726.037005:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002bb72922 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+9:5816:x1875760546579456:12345-0@lo:503: Request processed in 164us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864726.037012:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788864726.037081:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064f01ac1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546579456:0@lo:503: 00000100:00100000:1.0:1788864726.037445:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c74980e pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5859:1875760546579584:0@lo:502: 00000100:00100000:1.0:1788864726.038150:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864726.054673:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set 0000000000775513 going to sleep for 11 seconds 00000100:00100000:0.0:1788864726.054903:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546579584 00000100:00100000:0.0:1788864726.054914:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546579584 00000100:00100000:0.0:1788864726.054959:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788864726.054969:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000057dec65a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+9:5859:x1875760546579584:12345-0@lo:502: 00000100:00100000:0.0:1788864726.055233:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000057dec65a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+9:5859:x1875760546579584:12345-0@lo:502: Request processed in 266us (17084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864726.055242:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788864726.058359:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c74980e pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5859:1875760546579584:0@lo:502: 00000020:01000000:1.0:1788864726.058424:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788864726.058439:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864726.058442:0:5859:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788864726.058449:0:5859:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788864726.058452:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788864726.058481:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000aaeb2c04) 00000020:00000080:1.0:1788864726.058502:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788864726.058509:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788864726.058624:0:5859:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788864726.058632:0:5859:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf8c13e2d0e958f04 00000020:00000080:1.0:1788864726.058887:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788864726.058892:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788864726.058895:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864726.058897:0:5859:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788864726.058899:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788864726.058902:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864726.058903:0:5859:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788864726.058907:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788864726.058913:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000005635c313) 00000020:00000080:1.0:1788864726.058922:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788864726.058925:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788864726.058927:0:5859:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788864726.058930:0:5859:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788864726.058935:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788864726.058973:0:5859:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ce42f5c9 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788864726.058985:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000dfaf9ce1) 00000020:00000080:1.0:1788864726.058991:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788864726.059047:0:5859:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788864726.059058:0:5859:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf8c13e2d0e958f19 00000020:00000080:1.0:1788864726.059155:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788864726.059169:0:5859:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788864726.059174:0:5859:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf8c13e2d0e958f20 00080000:01000000:1.0:1788864726.059179:0:5859:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788864726.059183:0:5859:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf8c13e2d0e958f27 00080000:10000000:1.0:1788864726.059583:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1788864726.059863:0:5859:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788864726.066834:0:5859:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788864726.160802:0:5859:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788864726.161139:0:5859:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788864726.164041:0:5859:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788864726.164301:0:5859:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788864726.224051:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000f83b6ee2) 00000020:00000080:2.0:1788864726.224079:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788864726.224134:0:5859:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788864726.224139:0:5859:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf8c13e2d0e958f35 00000020:00000080:3.0:1788864726.226508:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788864726.227821:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788864726.281875:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788864726.319078:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788864726.384389:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788864726.463445:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788864726.501491:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788864726.559060:0:5859:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf8c13e2d0e958f3c 00000020:00000080:2.0:1788864726.560388:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788864726.560401:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864726.560408:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864726.560410:0:5859:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788864726.560415:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788864726.560419:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864726.560420:0:5859:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788864726.560423:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788864726.560424:0:5859:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788864726.560426:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864726.560428:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864726.560430:0:5859:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788864726.560432:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788864726.560436:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864726.560437:0:5859:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788864726.560442:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788864726.560482:0:5859:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788864726.560554:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8d50a8a pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5859:1875760546579712:0@lo:502: 00000100:00100000:2.0:1788864726.560628:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864726.560698:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set 000000005305b791 going to sleep for 11 seconds 00000100:00100000:1.0:1788864726.561107:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546579712 00000100:00100000:1.0:1788864726.561117:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546579712 00000100:00100000:1.0:1788864726.561176:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788864726.561185:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009e7fd046 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+9:5859:x1875760546579712:12345-0@lo:502: 00000100:00100000:1.0:1788864726.561520:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009e7fd046 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+9:5859:x1875760546579712:12345-0@lo:502: Request processed in 336us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864726.561528:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788864726.562242:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8d50a8a pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5859:1875760546579712:0@lo:502: 00000020:01000000:2.0:1788864726.562331:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864726.562338:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864726.562341:0:5859:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788864726.562346:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788864726.562615:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788864726.562638:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788864726.562984:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 000000004eae6753/0xf8c13e2d0e958eef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958ef6 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.562998:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 000000004eae6753/0xf8c13e2d0e958eef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958ef6 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788864726.563005:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fdc8878e000 from 1 10000000:01000000:1.0:1788864726.563017:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788864726.563046:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000cc1a5f20/0xf8c13e2d0e958f43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.563053:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000cc1a5f20/0xf8c13e2d0e958f43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.563062:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000cc1a5f20/0xf8c13e2d0e958f43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864726.563079:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c74980e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546579840:0@lo:101: 00000100:00100000:1.0:1788864726.563127:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864726.563598:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 0000000000775513 going to sleep for 11 seconds 00000100:00100000:2.0:1788864726.564432:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546579840 00000100:00100000:2.0:1788864726.564456:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546579840 00000100:00100000:2.0:1788864726.564541:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788864726.564550:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007cbdafc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+9:5816:x1875760546579840:12345-0@lo:101: 00010000:00010000:2.0:1788864726.564563:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864726.564580:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000028fec79a/0xf8c13e2d0e958f4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e958f43 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864726.564605:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000028fec79a/0xf8c13e2d0e958f4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e958f43 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864726.564615:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000028fec79a/0xf8c13e2d0e958f4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e958f43 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864726.564623:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000028fec79a, rc 0) 00000100:00100000:2.0:1788864726.564757:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007cbdafc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+10:5816:x1875760546579840:12345-0@lo:101: Request processed in 209us (1631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864726.564764:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788864726.565096:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c74980e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546579840:0@lo:101: 00010000:00010000:1.0:1788864726.565113:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000cc1a5f20/0xf8c13e2d0e958f43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958f4a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.565121:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000cc1a5f20/0xf8c13e2d0e958f43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e958f4a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864726.566655:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c74980e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546579968:0@lo:256: 00000100:00100000:1.0:1788864726.567453:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864726.567676:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 0000000000775513 going to sleep for 11 seconds 00000100:00100000:0.0:1788864726.567775:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546579968 00000100:00100000:0.0:1788864726.567784:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546579968 00000100:00100000:0.0:1788864726.567829:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788864726.567838:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004cbd4708 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+10:5816:x1875760546579968:12345-0@lo:256: 20000000:01000000:0.0:1788864726.567856:0:5827:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788864726.567861:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788864726.567930:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004cbd4708 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+10:5816:x1875760546579968:12345-0@lo:256: Request processed in 94us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864726.567938:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788864726.568022:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c74980e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546579968:0@lo:256: 10000000:01000000:1.0:1788864726.568645:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788864726.568662:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000cc1a5f20/0xf8c13e2d0e958f43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958f4a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.568674:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000cc1a5f20/0xf8c13e2d0e958f43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958f4a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788864726.568692:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fdc8878e000 from 1 10000000:01000000:1.0:1788864726.568695:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788864726.568747:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 000000005c28c077/0xf8c13e2d0e958f51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.568754:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 000000005c28c077/0xf8c13e2d0e958f51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.568762:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 000000005c28c077/0xf8c13e2d0e958f51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864726.568778:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c74980e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546580096:0@lo:101: 00000100:00100000:1.0:1788864726.568812:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864726.568961:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546580096 00000100:00100000:0.0:1788864726.568972:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546580096 00000100:00100000:0.0:1788864726.569008:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788864726.569014:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008c950a4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+10:5816:x1875760546580096:12345-0@lo:101: 00010000:00010000:0.0:1788864726.569023:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864726.569033:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005f3e9af8/0xf8c13e2d0e958f58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e958f51 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864726.569052:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005f3e9af8/0xf8c13e2d0e958f58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e958f51 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864726.569061:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005f3e9af8/0xf8c13e2d0e958f58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e958f51 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864726.569070:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005f3e9af8, rc 0) 00000100:00100000:0.0:1788864726.569096:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008c950a4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:5816:x1875760546580096:12345-0@lo:101: Request processed in 83us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864726.569102:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788864726.569240:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 0000000000775513 going to sleep for 11 seconds 00000100:00100000:1.0:1788864726.569257:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c74980e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546580096:0@lo:101: 00010000:00010000:1.0:1788864726.569268:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 000000005c28c077/0xf8c13e2d0e958f51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958f58 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.569275:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 000000005c28c077/0xf8c13e2d0e958f51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e958f58 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864726.569319:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c74980e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546580224:0@lo:501: 00000100:00100000:1.0:1788864726.569344:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864726.569399:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 0000000000775513 going to sleep for 11 seconds 00000100:00100000:0.0:1788864726.569439:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546580224 00000100:00100000:0.0:1788864726.569444:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546580224 00000100:00100000:0.0:1788864726.569498:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788864726.569505:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000de7b0265 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:5816:x1875760546580224:12345-0@lo:501: 00000100:00100000:0.0:1788864726.570053:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000de7b0265 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:5816:x1875760546580224:12345-0@lo:501: Request processed in 549us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864726.570061:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788864726.570184:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c74980e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546580224:0@lo:501: 00000100:00100000:1.0:1788864726.570212:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c74980e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546580352:0@lo:503: 00000100:00100000:1.0:1788864726.570255:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864726.570315:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 0000000000775513 going to sleep for 11 seconds 00000100:00100000:0.0:1788864726.570353:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546580352 00000100:00100000:0.0:1788864726.570358:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546580352 00000100:00100000:0.0:1788864726.570389:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788864726.570395:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ebe73101 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:5816:x1875760546580352:12345-0@lo:503: 00000040:00080000:0.0:1788864726.570428:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788864726.570477:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ebe73101 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:5816:x1875760546580352:12345-0@lo:503: Request processed in 83us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864726.570484:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788864726.570609:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c74980e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546580352:0@lo:503: 00000040:00080000:1.0:1788864726.571430:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788864726.571605:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788864726.571627:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788864726.571644:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 000000005c28c077/0xf8c13e2d0e958f51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958f58 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864726.571654:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 000000005c28c077/0xf8c13e2d0e958f51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958f58 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864726.571696:0:5816:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788864726.571698:0:5816:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fdc8878e000 10000000:01000000:2.0:1788864726.571731:0:5816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fdc8878e000 10000000:01000000:2.0:1788864726.571737:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788864726.571742:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fdc8878e000 from 1 10000000:01000000:2.0:1788864726.571753:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788864726.571781:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000d994dab3/0xf8c13e2d0e958f5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864726.571789:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000d994dab3/0xf8c13e2d0e958f5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864726.571797:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000d994dab3/0xf8c13e2d0e958f5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864726.571815:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8d50a8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546580480:0@lo:101: 00000100:00100000:2.0:1788864726.571862:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864726.571886:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 000000004fd35cd7 going to sleep for 11 seconds 00000100:00100000:1.0:1788864726.571941:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546580480 00000100:00100000:1.0:1788864726.571947:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546580480 00000100:00100000:1.0:1788864726.571982:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788864726.571988:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001074e98e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:5816:x1875760546580480:12345-0@lo:101: 00010000:00010000:1.0:1788864726.571997:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864726.572007:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000013c8ae7d/0xf8c13e2d0e958f66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e958f5f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.572027:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000013c8ae7d/0xf8c13e2d0e958f66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e958f5f expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.572035:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000013c8ae7d/0xf8c13e2d0e958f66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e958f5f expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.572043:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000013c8ae7d, rc 0) 00000100:00100000:1.0:1788864726.572074:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001074e98e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:5816:x1875760546580480:12345-0@lo:101: Request processed in 86us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864726.572080:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788864726.572147:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8d50a8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546580480:0@lo:101: 00010000:00010000:2.0:1788864726.572169:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000d994dab3/0xf8c13e2d0e958f5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958f66 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864726.572177:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000d994dab3/0xf8c13e2d0e958f5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e958f66 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864726.572216:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8d50a8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546580608:0@lo:501: 00000100:00100000:2.0:1788864726.572240:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864726.572256:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 000000004fd35cd7 going to sleep for 11 seconds 00000100:00100000:1.0:1788864726.572294:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546580608 00000100:00100000:1.0:1788864726.572299:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546580608 00000100:00100000:1.0:1788864726.572412:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788864726.572419:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005906b80c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:5816:x1875760546580608:12345-0@lo:501: 00000100:00100000:1.0:1788864726.572637:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005906b80c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:5816:x1875760546580608:12345-0@lo:501: Request processed in 219us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864726.572653:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788864726.572734:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8d50a8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546580608:0@lo:501: 00000100:00100000:0.0:1788864726.572761:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf843591 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546580736:0@lo:503: 00000100:00100000:0.0:1788864726.572797:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864726.572973:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032d59771 going to sleep for 11 seconds 00000100:00100000:2.0:1788864726.573017:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546580736 00000100:00100000:2.0:1788864726.573022:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546580736 00000100:00100000:2.0:1788864726.573043:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788864726.573048:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003c99fdbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:5816:x1875760546580736:12345-0@lo:503: 00000100:00100000:2.0:1788864726.573397:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003c99fdbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:5816:x1875760546580736:12345-0@lo:503: Request processed in 348us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864726.573411:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788864726.573493:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf843591 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546580736:0@lo:503: 00000100:00100000:3.0:1788864726.573942:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006561ab94 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5864:1875760546580864:0@lo:502: 00000100:00100000:3.0:1788864726.573982:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864726.574037:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set 000000009b8dddae going to sleep for 11 seconds 00000100:00100000:1.0:1788864726.574078:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546580864 00000100:00100000:1.0:1788864726.574083:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546580864 00000100:00100000:1.0:1788864726.574140:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788864726.574147:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000faaf6ba3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:5864:x1875760546580864:12345-0@lo:502: 00000100:00100000:1.0:1788864726.574349:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000faaf6ba3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:5864:x1875760546580864:12345-0@lo:502: Request processed in 203us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864726.574356:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788864726.574424:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006561ab94 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5864:1875760546580864:0@lo:502: 00000020:01000004:3.0:1788864726.574475:0:5864:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788864726.574488:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000001ee080c0) 00000020:00000080:3.0:1788864726.574506:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788864726.574571:0:5864:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ce42f5c9 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788864726.574575:0:5864:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ce42f5c9 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788864726.574577:0:5864:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ce42f5c9 4 00010000:00080000:3.0:1788864726.574602:0:5864:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006f5e974f@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:3.0:1788864726.576228:0:5864:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788864726.578069:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788864726.578107:0:5864:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788864726.578124:0:5864:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf8c13e2d0e958f74 00000100:00080000:3.0:1788864726.578135:0:5864:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788864726.578144:0:5864:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006f5e974f using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788864726.582290:0:5864:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006561ab94 x1875760546580992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788864726.582320:0:5864:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788864726.582390:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006561ab94 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875760546580992:0@lo:38: 00000100:00100000:2.0:1788864726.582460:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864726.582587:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546580992 00000100:00100000:1.0:1788864726.582595:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546580992 00000100:00100000:1.0:1788864726.582634:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788864726.582640:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000737f99c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875760546580992:12345-0@lo:38: 00000100:00100000:1.0:1788864726.582694:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000737f99c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875760546580992:12345-0@lo:38: Request processed in 52us (234us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788864726.582725:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788864726.583000:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788864726.583008:0:3299:0:(import.c:65:import_set_state_nolock()) 000000006f5e974f lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788864726.583012:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788864726.583015:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006561ab94 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875760546580992:0@lo:38: 00000100:00100000:2.0:1788864726.583189:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d69f4402 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5864:1875760546581120:0@lo:502: 00000100:00100000:2.0:1788864726.583230:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864726.583263:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e6753d14 going to sleep for 11 seconds 00000100:00100000:1.0:1788864726.583302:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546581120 00000100:00100000:1.0:1788864726.583307:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546581120 00000100:00100000:1.0:1788864726.583341:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788864726.583348:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000852c5be0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:5864:x1875760546581120:12345-0@lo:502: 00000100:00100000:1.0:1788864726.583549:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000852c5be0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:5864:x1875760546581120:12345-0@lo:502: Request processed in 201us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864726.583556:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788864726.583735:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d69f4402 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5864:1875760546581120:0@lo:502: 00000040:00080000:2.0:1788864726.583756:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788864726.583904:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788864726.583924:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788864726.583943:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000d994dab3/0xf8c13e2d0e958f5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958f66 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.583967:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000d994dab3/0xf8c13e2d0e958f5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958f66 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788864726.584009:0:5816:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788864726.584011:0:5816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788864726.584013:0:5816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788864726.584014:0:5816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788864726.584016:0:5816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788864726.584017:0:5816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788864726.584018:0:5816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788864726.584020:0:5816:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788864726.584021:0:5816:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788864726.584022:0:5816:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788864726.584024:0:5816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788864726.584025:0:5816:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788864726.584029:0:5816:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788864726.584031:0:5816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788864726.584032:0:5816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788864726.584034:0:5816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788864726.584034:0:5816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788864726.584036:0:5816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788864726.584037:0:5816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788864726.584038:0:5816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788864726.584039:0:5816:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788864726.584040:0:5816:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788864726.584040:0:5816:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788864726.584041:0:5816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788864726.584042:0:5816:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788864726.584059:0:5816:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788864726.584068:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c74980e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546581248:0@lo:253: 00000100:00100000:1.0:1788864726.584099:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864726.584127:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b0c2872 going to sleep for 11 seconds 00000100:00100000:3.0:1788864726.584177:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546581248 00000100:00100000:3.0:1788864726.584182:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546581248 00000100:00100000:3.0:1788864726.584213:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788864726.584219:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000aa25f107 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:5816:x1875760546581248:12345-0@lo:253: 20000000:01000000:3.0:1788864726.584237:0:5828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788864726.584249:0:5828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:2.0:1788864726.599207:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1788864726.623051:0:5828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788864726.623069:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788864726.623207:0:5851:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788864726.623212:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788864726.623232:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000eb9fba09/0xf8c13e2d0e958f7b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.623262:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000028fec79a/0xf8c13e2d0e958f4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e958f43 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.623270:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000eb9fba09/0xf8c13e2d0e958f7b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.623306:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000028fec79a/0xf8c13e2d0e958f4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e958f43 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864726.623319:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000028fec79a/0xf8c13e2d0e958f4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e958f43 expref: 12 pid: 5828 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864726.623332:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000007000fec pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1875760546581376:0@lo:104: 00000100:00100000:1.0:1788864726.623392:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864726.623446:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set 000000006a26b032 going to sleep for 11 seconds 00000100:00100000:2.0:1788864726.623531:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546581376 00000100:00100000:2.0:1788864726.623540:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546581376 00000100:00100000:2.0:1788864726.623597:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788864726.623605:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000795d9e8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+3:5851:x1875760546581376:12345-0@lo:104: 00010000:00010000:2.0:1788864726.623617:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 00000000cc1a5f20/0xf8c13e2d0e958f43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e958f4a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864726.623689:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788864726.623695:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000795d9e8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+3:5851:x1875760546581376:12345-0@lo:104: Request processed in 91us (303us total) trans 0 rc 0/0 00010000:00010000:0.0:1788864726.623718:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788864726.623721:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788864726.623724:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 00000000cc1a5f20/0xf8c13e2d0e958f43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e958f4a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864726.623731:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cc1a5f20 already unused, calling callback (00000000051492a5) 10000000:00010000:0.0:1788864726.623734:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 00000000cc1a5f20/0xf8c13e2d0e958f43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e958f4a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864726.623741:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 00000000cc1a5f20/0xf8c13e2d0e958f43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e958f4a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788864726.623747:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 00000000cc1a5f20/0xf8c13e2d0e958f43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e958f4a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864726.623753:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1788864726.623754:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000007000fec pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1875760546581376:0@lo:104: 00010000:00010000:2.0:1788864726.623777:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000eb9fba09/0xf8c13e2d0e958f7b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864726.623778:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 00000000cc1a5f20/0xf8c13e2d0e958f43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e958f4a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864726.623784:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788864726.623803:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 00000000cc1a5f20/0xf8c13e2d0e958f43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e958f4a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864726.623809:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 00000000cc1a5f20/0xf8c13e2d0e958f43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e958f4a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864726.623826:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864726.623829:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864726.623830:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864726.624055:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf843591 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546581504:0@lo:103: 00000100:00100000:2.0:1788864726.624085:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864726.626266:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546581504 00000100:00100000:0.0:1788864726.626281:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546581504 00010000:00010000:0.0:1788864726.626315:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000028fec79a/0xf8c13e2d0e958f4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e958f43 expref: 13 pid: 5828 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864726.626353:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788864726.626361:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d69f4402 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:3301:x1875760546581504:12345-0@lo:103: 00010000:00010000:0.0:1788864726.626374:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864726.626379:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000028fec79a/0xf8c13e2d0e958f4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e958f43 expref: 13 pid: 5828 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864726.626390:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000028fec79a/0xf8c13e2d0e958f4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e958f43 expref: 13 pid: 5828 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864726.626405:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000028fec79a/0xf8c13e2d0e958f4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e958f43 expref: 13 pid: 5828 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864726.626419:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000eb9fba09/0xf8c13e2d0e958f7b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864726.626427:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eb9fba09/0xf8c13e2d0e958f7b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788864726.626462:0:5820:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003249563s 00010000:00010000:0.0:1788864726.626466:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000eb9fba09/0xf8c13e2d0e958f7b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864726.626472:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000eb9fba09/0xf8c13e2d0e958f7b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864726.626477:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000eb9fba09/0xf8c13e2d0e958f7b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864726.626484:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000eb9fba09/0xf8c13e2d0e958f7b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864726.626489:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eb9fba09 already unused, calling callback (00000000a9328086) 00010000:00010000:0.0:1788864726.626493:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000eb9fba09/0xf8c13e2d0e958f7b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864726.626499:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000eb9fba09/0xf8c13e2d0e958f7b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864726.626517:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000eb9fba09/0xf8c13e2d0e958f7b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864726.626527:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864726.626595:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d69f4402 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:3301:x1875760546581504:12345-0@lo:103: Request processed in 235us (2509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864726.626603:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788864726.626641:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf843591 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546581504:0@lo:103: 00010000:00010000:2.0:1788864726.626799:0:5851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000eb9fba09/0xf8c13e2d0e958f7b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864726.626808:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000eb9fba09/0xf8c13e2d0e958f7b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864726.626814:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000eb9fba09/0xf8c13e2d0e958f7b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864726.638469:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000aa25f107 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:5816:x1875760546581248:12345-0@lo:253: Request processed in 54241us (54360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864726.638485:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788864726.639514:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c74980e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5816:1875760546581248:0@lo:253: 10000000:01000000:1.0:1788864726.639532:0:5816:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788864726.639535:0:5816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788864726.639536:0:5816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788864726.639538:0:5816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788864726.639539:0:5816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788864726.639540:0:5816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788864726.639541:0:5816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788864726.639542:0:5816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788864726.639544:0:5816:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788864726.639545:0:5816:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788864726.639547:0:5816:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788864726.639548:0:5816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788864726.639549:0:5816:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788864726.639563:0:5816:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788864726.645257:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788864726.645639:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788864726.645889:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788864726.646056:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788864726.646270:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788864726.646486:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788864726.651081:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788864726.651279:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788864726.651769:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788864726.652036:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788864726.652250:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788864726.652631:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788864726.699346:0:5816:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788864726.741927:0:5816:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788864726.742076:0:5869:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788864726.742080:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788864726.742220:0:5870:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788864726.744675:0:5816:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788864726.744888:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788864726.745429:0:5816:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788864726.745437:0:5816:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788864726.745566:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788864726.746744:0:5816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788864726.747447:0:5816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788864726.747480:0:5816:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788864726.748365:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788864726.748660:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1788864726.751528:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788864726.751666:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788864726.751886:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788864726.752025:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788864726.752183:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788864726.752319:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788864726.752481:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788864726.754181:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788864726.754394:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788864726.754545:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788864726.754739:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788864726.754861:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788864726.755005:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788864726.757381:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788864726.757548:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788864726.757686:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788864726.758306:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788864726.758477:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788864726.758652:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788864726.758835:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788864726.758995:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788864726.760362:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788864726.760581:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788864726.760989:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788864726.761845:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788864726.762086:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788864726.762238:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788864726.762376:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788864726.762514:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788864726.762683:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788864726.762941:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788864726.763186:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788864726.763383:0:5816:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788864726.799180:0:5870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1788864726.847387:0:5816:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788864726.847428:0:5816:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd8c81c77988 00100000:10000000:1.0:1788864726.847436:0:5816:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788864726.848410:0:5816:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788864726.848426:0:5816:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788864726.848479:0:5816:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788864726.848507:0:5816:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1788864726.899217:0:5870:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788864726.899287:0:5870:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788864726.899299:0:5870:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788864727.622460:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864728.644962:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864729.669072:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788864730.591369:0:6112:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788864730.693496:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864731.719093:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788864731.975746:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788864731.975755:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788864731.975758:0:36:0:(import.c:65:import_set_state_nolock()) 000000006f5e974f lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788864731.975773:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006f5e974f using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1788864731.975793:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000463a0f82 x1875760546581760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788864731.975919:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c74980e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546581632:0@lo:400: 00000100:00100000:1.0:1788864731.976001:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864731.976086:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000463a0f82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875760546581760:0@lo:38: 00000100:00100000:1.0:1788864731.976128:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864731.976503:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546581632 00000100:00100000:2.0:1788864731.976513:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546581632 00000100:00100000:2.0:1788864731.976558:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788864731.976566:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ea76354d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:3302:x1875760546581632:12345-0@lo:400: 00000100:00100000:2.0:1788864731.976626:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ea76354d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:3302:x1875760546581632:12345-0@lo:400: Request processed in 61us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864731.976634:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788864731.977393:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c74980e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546581632:0@lo:400: 00000100:00100000:0.0:1788864731.978022:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546581760 00000100:00100000:0.0:1788864731.978030:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546581760 00000100:00100000:0.0:1788864731.978070:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788864731.978075:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f80ffaa2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1875760546581760:12345-0@lo:38: 00010000:00080000:0.0:1788864731.978098:0:5837:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 155 last 0 00000020:00000080:0.0:1788864731.978160:0:5837:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf8c13e2d0e958f82 00000004:00100000:0.0:1788864731.978204:0:5837:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788864731.978344:0:5837:0:(import.c:65:import_set_state_nolock()) 00000000f28181eb : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788864731.978411:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f80ffaa2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875760546581760:12345-0@lo:38: Request processed in 335us (2282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864731.978418:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788864731.978834:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000463a0f82 x1875760546581760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788864741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788864731.978850:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788864731.978857:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788864731.978861:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788864731.978863:0:3299:0:(import.c:65:import_set_state_nolock()) 000000006f5e974f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788864731.978868:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000463a0f82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875760546581760:0@lo:38: 00010000:00010000:1.0:1788864732.740977:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788864733.514541:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788864733.514549:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fdc8878e000 from 3 10000000:01000000:2.0:1788864733.514554:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788864733.514614:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000ffe0fdbd/0xf8c13e2d0e958f89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864733.514626:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000ffe0fdbd/0xf8c13e2d0e958f89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864733.514636:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000ffe0fdbd/0xf8c13e2d0e958f89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864733.514658:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000027888cfc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546581888:0@lo:101: 00000100:00100000:2.0:1788864733.514756:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864733.514823:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000902b981b going to sleep for 11 seconds 00000100:00100000:1.0:1788864733.517099:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546581888 00000100:00100000:1.0:1788864733.517123:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546581888 00000100:00100000:1.0:1788864733.517202:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788864733.517211:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000058c213d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:5832:x1875760546581888:12345-0@lo:101: 00010000:00010000:1.0:1788864733.517227:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864733.517246:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006ead1faa/0xf8c13e2d0e958f90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e958f89 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864733.517273:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006ead1faa/0xf8c13e2d0e958f90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e958f89 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864733.517283:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006ead1faa/0xf8c13e2d0e958f90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e958f89 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864733.517291:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006ead1faa, rc 0) 00000100:00100000:1.0:1788864733.517367:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000058c213d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:5832:x1875760546581888:12345-0@lo:101: Request processed in 158us (2611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864733.517374:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788864733.517598:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000027888cfc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546581888:0@lo:101: 00010000:00010000:3.0:1788864733.517614:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000ffe0fdbd/0xf8c13e2d0e958f89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958f90 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864733.517623:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000ffe0fdbd/0xf8c13e2d0e958f89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e958f90 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864733.517687:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004bd63d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546582016:0@lo:256: 00000100:00100000:3.0:1788864733.517759:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864733.517790:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1431a83 going to sleep for 11 seconds 00000100:00100000:1.0:1788864733.518054:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546582016 00000100:00100000:1.0:1788864733.518067:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546582016 00000100:00100000:1.0:1788864733.518114:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788864733.518121:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002ea50adb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:5832:x1875760546582016:12345-0@lo:256: 20000000:01000000:1.0:1788864733.518134:0:5830:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788864733.518150:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788864733.518153:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788864733.518226:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002ea50adb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:5832:x1875760546582016:12345-0@lo:256: Request processed in 107us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864733.518234:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788864733.518440:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004bd63d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546582016:0@lo:256: 10000000:01000000:0.0:1788864733.518481:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788864733.518487:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000ffe0fdbd/0xf8c13e2d0e958f89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958f90 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864733.518496:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000ffe0fdbd/0xf8c13e2d0e958f89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958f90 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864733.764954:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864734.790982:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788864735.017505:0:6314:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd290be770 20000000:00000080:3.0:1788864735.017523:0:6314:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fdca2c6cc00 uarg=0000000000000000 20000000:01000000:3.0:1788864735.017555:0:6314:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788864735.017561:0:6314:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788864735.017566:0:6314:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788864735.018896:0:6314:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788864735.018912:0:6314:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788864735.023921:0:6314:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788864735.024354:0:6314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788864735.024407:0:6314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788864735.024455:0:6314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788864735.024555:0:6314:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788864735.024573:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004d3bd76d/0xf8c13e2d0e958f97 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864735.024591:0:6314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005f3e9af8/0xf8c13e2d0e958f58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e958f51 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864735.024653:0:6314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004d3bd76d/0xf8c13e2d0e958f97 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864735.024691:0:6314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005f3e9af8/0xf8c13e2d0e958f58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e958f51 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864735.024724:0:6314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005f3e9af8/0xf8c13e2d0e958f58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e958f51 expref: 11 pid: 5828 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864735.024738:0:6314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008b10bfc9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6314:1875760546582144:0@lo:104: 00000100:00100000:3.0:1788864735.024800:0:6314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864735.024859:0:6314:0:(client.c:2716:ptlrpc_set_wait()) set 000000009ffa4d0f going to sleep for 11 seconds 00000100:00100000:2.0:1788864735.025122:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546582144 00000100:00100000:2.0:1788864735.025131:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546582144 00000100:00100000:2.0:1788864735.025182:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788864735.025190:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006221aad6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+3:6314:x1875760546582144:12345-0@lo:104: 00010000:00010000:2.0:1788864735.025203:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 000000005c28c077/0xf8c13e2d0e958f51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e958f58 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864735.025269:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788864735.025275:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006221aad6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+3:6314:x1875760546582144:12345-0@lo:104: Request processed in 86us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864735.025282:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788864735.025337:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788864735.025343:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 000000005c28c077/0xf8c13e2d0e958f51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e958f58 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864735.025350:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005c28c077 already unused, calling callback (00000000051492a5) 10000000:00010000:1.0:1788864735.025353:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 000000005c28c077/0xf8c13e2d0e958f51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e958f58 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864735.025361:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 000000005c28c077/0xf8c13e2d0e958f51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e958f58 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788864735.025367:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 000000005c28c077/0xf8c13e2d0e958f51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e958f58 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788864735.025373:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788864735.025408:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 000000005c28c077/0xf8c13e2d0e958f51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e958f58 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864735.025414:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788864735.025439:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 000000005c28c077/0xf8c13e2d0e958f51 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e958f58 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864735.025445:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 000000005c28c077/0xf8c13e2d0e958f51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e958f58 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864735.025466:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864735.025468:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864735.025470:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864735.025480:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000463a0f82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546582272:0@lo:103: 00000100:00100000:1.0:1788864735.025509:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864735.025631:0:6314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008b10bfc9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6314:1875760546582144:0@lo:104: 00000100:00100000:0.0:1788864735.025645:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546582272 00010000:00010000:3.0:1788864735.025648:0:6314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004d3bd76d/0xf8c13e2d0e958f97 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864735.025649:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546582272 00010000:00010000:0.0:1788864735.025667:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005f3e9af8/0xf8c13e2d0e958f58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e958f51 expref: 12 pid: 5828 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864735.025693:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788864735.025699:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006c74980e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:3303:x1875760546582272:12345-0@lo:103: 00010000:00010000:0.0:1788864735.025743:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864735.025749:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005f3e9af8/0xf8c13e2d0e958f58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e958f51 expref: 12 pid: 5828 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864735.025758:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005f3e9af8/0xf8c13e2d0e958f58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e958f51 expref: 12 pid: 5828 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864735.025769:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005f3e9af8/0xf8c13e2d0e958f58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e958f51 expref: 12 pid: 5828 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864735.025782:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004d3bd76d/0xf8c13e2d0e958f97 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864735.025789:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004d3bd76d/0xf8c13e2d0e958f97 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864735.025802:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004d3bd76d/0xf8c13e2d0e958f97 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864735.025808:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004d3bd76d/0xf8c13e2d0e958f97 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864735.025814:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004d3bd76d/0xf8c13e2d0e958f97 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864735.025820:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004d3bd76d/0xf8c13e2d0e958f97 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864735.025825:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004d3bd76d already unused, calling callback (00000000a9328086) 00010000:00010000:0.0:1788864735.025828:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004d3bd76d/0xf8c13e2d0e958f97 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864735.025845:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004d3bd76d/0xf8c13e2d0e958f97 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864735.025863:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004d3bd76d/0xf8c13e2d0e958f97 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864735.025873:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864735.025904:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006c74980e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:3303:x1875760546582272:12345-0@lo:103: Request processed in 206us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864735.025911:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788864735.025936:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000463a0f82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546582272:0@lo:103: 00010000:00010000:1.0:1788864735.026061:0:6314:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004d3bd76d/0xf8c13e2d0e958f97 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864735.026068:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004d3bd76d/0xf8c13e2d0e958f97 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864735.026073:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004d3bd76d/0xf8c13e2d0e958f97 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864735.814983:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864736.840104:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864737.103147:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000082730b1d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546582400:0@lo:400: 00000100:00100000:1.0:1788864737.103218:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864737.103268:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788864737.103274:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce597093 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546582528:0@lo:400: 00000100:00100000:1.0:1788864737.103300:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864737.103333:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546582400 00000100:00100000:1.0:1788864737.103341:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546582400 00000100:00100000:1.0:1788864737.103381:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788864737.103401:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fe71b5ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:3300:x1875760546582400:12345-0@lo:400: 00000100:00100000:1.0:1788864737.103446:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fe71b5ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:3300:x1875760546582400:12345-0@lo:400: Request processed in 46us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864737.103454:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788864737.103487:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546582528 00000100:00100000:1.0:1788864737.103491:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546582528 00000100:00100000:1.0:1788864737.103515:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788864737.103521:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002baf1a5d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546582528:12345-0@lo:400: 00000100:00100000:1.0:1788864737.103550:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002baf1a5d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546582528:12345-0@lo:400: Request processed in 30us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864737.103557:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788864737.103593:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ce597093 x1875760546582528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864737.103606:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce597093 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546582528:0@lo:400: 00000100:00100000:1.0:1788864737.103615:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000082730b1d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546582400:0@lo:400: 00010000:00010000:3.0:1788864737.861790:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864738.886000:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864739.910500:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788864740.128961:0:6679:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788864740.128964:0:6679:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788864740.129106:0:6679:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000004e6ef46f 00000020:01000004:1.0:1788864740.129123:0:6679:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788864740.129134:0:6679:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788864740.129146:0:6679:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000102683fd) 00000020:00000080:1.0:1788864740.129166:0:6679:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788864740.142847:0:6679:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788864740.143193:0:6679:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788864740.167169:0:6679:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788864740.175339:0:6679:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788864740.175370:0:6679:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788864740.175800:0:6679:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788864740.175851:0:6679:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788864740.176202:0:6679:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788864740.176212:0:6679:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788864740.176221:0:6679:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf8c13e2d0e958fa5 00000020:01000004:1.0:1788864740.176228:0:6679:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788864740.176249:0:6679:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788864740.176252:0:6679:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788864740.176257:0:6679:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788864740.176261:0:6679:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788864740.176279:0:6679:0:(genops.c:413:class_newdev()) Allocate new device OSS (000000003d2c9d58) 00000020:00000080:1.0:1788864740.176291:0:6679:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1788864740.177355:0:6679:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788864740.177508:0:6679:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788864740.177514:0:6679:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788864740.183511:0:6679:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788864740.183525:0:6679:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788864740.185000:0:6679:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788864740.185011:0:6679:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788864740.191326:0:6679:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788864740.192215:0:6679:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788864740.192231:0:6679:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788864740.193494:0:6679:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788864740.193503:0:6679:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788864740.223494:0:6679:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788864740.224096:0:6679:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788864740.224112:0:6679:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788864740.226863:0:6679:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788864740.226877:0:6679:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788864740.228010:0:6679:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788864740.228018:0:6679:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788864740.232329:0:6679:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788864740.232671:0:6679:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788864740.232678:0:6679:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788864740.233883:0:6679:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788864740.233893:0:6679:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788864740.307289:0:6679:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788864740.307564:0:6679:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788864740.307572:0:6679:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788864740.308931:0:6679:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788864740.308942:0:6679:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788864740.309434:0:6679:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788864740.309467:0:6679:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788864740.309473:0:6679:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788864740.332695:0:6679:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788864740.332764:0:6679:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788864740.332768:0:6679:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788864740.332771:0:6679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788864740.332772:0:6679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788864740.332773:0:6679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788864740.332774:0:6679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788864740.332776:0:6679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788864740.332777:0:6679:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788864740.332778:0:6679:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788864740.332779:0:6679:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788864740.332780:0:6679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788864740.332782:0:6679:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788864740.332785:0:6679:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788864740.332787:0:6679:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788864740.332793:0:6679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788864740.332794:0:6679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788864740.332795:0:6679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788864740.332795:0:6679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788864740.332796:0:6679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788864740.332797:0:6679:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788864740.332798:0:6679:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788864740.332799:0:6679:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788864740.332799:0:6679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788864740.332800:0:6679:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788864740.332824:0:6679:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788864740.332840:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000082730b1d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546582656:0@lo:253: 00000100:00100000:1.0:1788864740.332912:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864740.333083:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546582656 00000100:00100000:2.0:1788864740.333091:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546582656 00000100:00100000:2.0:1788864740.333135:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788864740.333142:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ab7c7490 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:6679:x1875760546582656:12345-0@lo:253: 20000000:01000000:2.0:1788864740.333169:0:5827:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788864740.333172:0:5827:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788864740.333177:0:5827:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788864740.333180:0:5827:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788864740.334089:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788864740.334164:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set 0000000069753d4c going to sleep for 11 seconds 00000040:00080000:2.0:1788864740.334292:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788864740.334304:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788864740.334343:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1788864740.334350:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788864740.334380:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788864740.334430:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788864740.334781:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788864740.334799:0:5827:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:2.0:1788864740.334801:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:2.0:1788864740.334835:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788864740.334843:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788864740.334904:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788864740.334912:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:2.0:1788864740.334942:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788864740.334950:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788864740.334977:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788864740.335026:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788864740.335611:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788864740.335621:0:5827:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:2.0:1788864740.335628:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:2.0:1788864740.335662:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788864740.335669:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788864740.335701:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788864740.335737:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:2.0:1788864740.335784:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788864740.335793:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788864740.335823:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788864740.335858:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788864740.335874:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788864740.335877:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788864740.335881:0:5827:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788864740.335894:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788864740.335897:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788864740.335928:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788864740.335931:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788864740.336849:0:6695:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788864740.336910:0:6695:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788864740.336988:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788864740.337676:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788864740.338519:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788864740.338591:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788864740.338608:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788864740.338610:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788864740.339277:0:6696:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788864740.339322:0:6696:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788864740.339368:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788864740.339619:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1788864740.339850:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1788864740.339887:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1788864740.339899:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788864740.339901:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788864740.340451:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788864740.340683:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1788864740.340907:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1788864740.343427:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1788864740.343468:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1788864740.343471:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1788864740.343479:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788864740.343498:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000915f783c/0xf8c13e2d0e958fb3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864740.343528:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fd657d99/0xf8c13e2d0e958eda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e958ed3 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864740.343535:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008c9c7da3/0xf8c13e2d0e958ef6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e958eef expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864740.343539:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000013c8ae7d/0xf8c13e2d0e958f66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e958f5f expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864740.343545:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000915f783c/0xf8c13e2d0e958fb3 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864740.343583:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000013c8ae7d/0xf8c13e2d0e958f66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e958f5f expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864740.343597:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000013c8ae7d/0xf8c13e2d0e958f66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e958f5f expref: 11 pid: 5828 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864740.343611:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000634ea3fe pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1875760546582784:0@lo:104: 00000100:00100000:2.0:1788864740.343915:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788864740.344034:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008c9c7da3/0xf8c13e2d0e958ef6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e958eef expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864740.344042:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008c9c7da3/0xf8c13e2d0e958ef6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e958eef expref: 11 pid: 5828 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864740.344051:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b382ccc9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1875760546582912:0@lo:104: 00000100:00100000:2.0:1788864740.344082:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788864740.344492:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fd657d99/0xf8c13e2d0e958eda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e958ed3 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864740.344510:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fd657d99/0xf8c13e2d0e958eda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e958ed3 expref: 11 pid: 5828 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864740.344518:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008644d95b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1875760546583040:0@lo:104: 00000100:00100000:2.0:1788864740.344541:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864740.344563:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546582784 00000100:00100000:1.0:1788864740.344571:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546582784 00000100:00100000:0.0:1788864740.344622:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546582912 00000100:00100000:0.0:1788864740.344627:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546582912 00000100:00100000:0.0:1788864740.344661:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788864740.344677:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000578097ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+4:5827:x1875760546582784:12345-0@lo:104: 00010000:00010000:0.0:1788864740.344689:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 00000000d994dab3/0xf8c13e2d0e958f5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e958f66 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864740.344762:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788864740.344768:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000578097ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+4:5827:x1875760546582784:12345-0@lo:104: Request processed in 93us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864740.344775:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788864740.344793:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788864740.344799:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002463f73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+3:5827:x1875760546582912:12345-0@lo:104: 00010000:00010000:0.0:1788864740.344805:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 000000004eae6753/0xf8c13e2d0e958eef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e958ef6 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864740.344834:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788864740.344838:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002463f73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+3:5827:x1875760546582912:12345-0@lo:104: Request processed in 41us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864740.344844:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788864740.344904:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788864740.344910:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 00000000d994dab3/0xf8c13e2d0e958f5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e958f66 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.344916:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d994dab3 already unused, calling callback (00000000051492a5) 10000000:00010000:3.0:1788864740.344919:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 00000000d994dab3/0xf8c13e2d0e958f5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e958f66 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.344925:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 00000000d994dab3/0xf8c13e2d0e958f5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e958f66 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788864740.344931:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 00000000d994dab3/0xf8c13e2d0e958f5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e958f66 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864740.344936:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788864740.345136:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 00000000d994dab3/0xf8c13e2d0e958f5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e958f66 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.345143:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788864740.345162:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 00000000d994dab3/0xf8c13e2d0e958f5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e958f66 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.345168:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 00000000d994dab3/0xf8c13e2d0e958f5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e958f66 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.345183:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788864740.345185:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 000000004eae6753/0xf8c13e2d0e958eef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e958ef6 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.345197:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004eae6753 already unused, calling callback (00000000051492a5) 10000000:00010000:3.0:1788864740.345199:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 000000004eae6753/0xf8c13e2d0e958eef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e958ef6 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.345205:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 000000004eae6753/0xf8c13e2d0e958eef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e958ef6 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788864740.345210:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 000000004eae6753/0xf8c13e2d0e958eef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e958ef6 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864740.345215:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788864740.345230:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 000000004eae6753/0xf8c13e2d0e958eef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e958ef6 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.345235:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788864740.345240:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 000000004eae6753/0xf8c13e2d0e958eef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e958ef6 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.345244:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 000000004eae6753/0xf8c13e2d0e958eef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e958ef6 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.345252:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864740.345254:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864740.345256:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864740.345262:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864740.345272:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008b10bfc9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546583168:0@lo:103: 00000100:00100000:3.0:1788864740.345300:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864740.345330:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788864740.345335:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ecb4db95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546583296:0@lo:103: 00000100:00100000:3.0:1788864740.345364:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864740.345397:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546583168 00000100:00100000:3.0:1788864740.345402:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546583168 00010000:00010000:3.0:1788864740.345419:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000013c8ae7d/0xf8c13e2d0e958f66 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e958f5f expref: 12 pid: 5828 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864740.345438:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546583296 00000100:00100000:3.0:1788864740.345441:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546583296 00010000:00010000:3.0:1788864740.345450:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008c9c7da3/0xf8c13e2d0e958ef6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e958eef expref: 13 pid: 5828 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864740.345461:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788864740.345467:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a7940a0d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:3302:x1875760546583168:12345-0@lo:103: 00010000:00010000:3.0:1788864740.345476:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864740.345480:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000013c8ae7d/0xf8c13e2d0e958f66 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e958f5f expref: 13 pid: 5828 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.345487:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000013c8ae7d/0xf8c13e2d0e958f66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e958f5f expref: 13 pid: 5828 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.345503:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788864740.345527:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a7940a0d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:3302:x1875760546583168:12345-0@lo:103: Request processed in 61us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864740.345533:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788864740.345545:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788864740.345551:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d66fc31d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:3302:x1875760546583296:12345-0@lo:103: 00010000:00010000:3.0:1788864740.345557:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864740.345560:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008c9c7da3/0xf8c13e2d0e958ef6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e958eef expref: 12 pid: 5828 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.345576:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008c9c7da3/0xf8c13e2d0e958ef6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e958eef expref: 12 pid: 5828 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.345586:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788864740.345605:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d66fc31d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:3302:x1875760546583296:12345-0@lo:103: Request processed in 56us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864740.345612:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788864740.345646:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ecb4db95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546583296:0@lo:103: 00000100:00100000:3.0:1788864740.345654:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008b10bfc9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546583168:0@lo:103: 00000100:00100000:2.0:1788864740.345941:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 0000000056750d89 going to sleep for 11 seconds 00010000:00010000:2.0:1788864740.345954:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000013c8ae7d/0xf8c13e2d0e958f66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e958f5f expref: 11 pid: 5828 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864740.346132:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000634ea3fe pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1875760546582784:0@lo:104: 00010000:00010000:2.0:1788864740.346146:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008c9c7da3/0xf8c13e2d0e958ef6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e958eef expref: 10 pid: 5828 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864740.346154:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b382ccc9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1875760546582912:0@lo:104: 00000100:00100000:0.0:1788864740.346194:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546583040 00000100:00100000:0.0:1788864740.346199:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546583040 00000100:00100000:0.0:1788864740.346220:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788864740.346225:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002a4b5769 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+3:5827:x1875760546583040:12345-0@lo:104: 00010000:00010000:0.0:1788864740.346233:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 00000000f44eb64d/0xf8c13e2d0e958ed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e958eda expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864740.346278:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788864740.346283:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002a4b5769 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+3:5827:x1875760546583040:12345-0@lo:104: Request processed in 59us (1742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864740.346289:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788864740.346345:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008644d95b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1875760546583040:0@lo:104: 00010000:00010000:2.0:1788864740.346366:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000915f783c/0xf8c13e2d0e958fb3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.346796:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788864740.346801:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 00000000f44eb64d/0xf8c13e2d0e958ed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e958eda expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.346809:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f44eb64d already unused, calling callback (00000000051492a5) 10000000:00010000:3.0:1788864740.346811:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 00000000f44eb64d/0xf8c13e2d0e958ed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e958eda expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.346818:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 00000000f44eb64d/0xf8c13e2d0e958ed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e958eda expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788864740.346823:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 00000000f44eb64d/0xf8c13e2d0e958ed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e958eda expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864740.346829:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788864740.346862:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 00000000f44eb64d/0xf8c13e2d0e958ed3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e958eda expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.346868:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788864740.346900:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 00000000f44eb64d/0xf8c13e2d0e958ed3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e958eda expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.346906:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 00000000f44eb64d/0xf8c13e2d0e958ed3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e958eda expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.346922:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864740.346923:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864740.346925:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864740.346931:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788864740.346941:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008b10bfc9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546583424:0@lo:103: 00000100:00100000:3.0:1788864740.347263:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864740.347348:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546583424 00000100:00100000:1.0:1788864740.347354:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546583424 00010000:00010000:1.0:1788864740.347374:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fd657d99/0xf8c13e2d0e958eda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e958ed3 expref: 10 pid: 5828 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864740.347428:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788864740.347434:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ecb4db95 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+10:3301:x1875760546583424:12345-0@lo:103: 00010000:00010000:1.0:1788864740.347444:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864740.347448:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fd657d99/0xf8c13e2d0e958eda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e958ed3 expref: 10 pid: 5828 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.347457:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fd657d99/0xf8c13e2d0e958eda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e958ed3 expref: 10 pid: 5828 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.347468:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fd657d99/0xf8c13e2d0e958eda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e958ed3 expref: 10 pid: 5828 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.347482:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000915f783c/0xf8c13e2d0e958fb3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.347496:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000915f783c/0xf8c13e2d0e958fb3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.347509:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000915f783c/0xf8c13e2d0e958fb3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.347515:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000915f783c/0xf8c13e2d0e958fb3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.347522:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000915f783c/0xf8c13e2d0e958fb3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.347527:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000915f783c/0xf8c13e2d0e958fb3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.347531:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000915f783c already unused, calling callback (00000000a9328086) 00010000:00010000:1.0:1788864740.347534:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000915f783c/0xf8c13e2d0e958fb3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.347540:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000915f783c/0xf8c13e2d0e958fb3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864740.347872:0:5827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000915f783c/0xf8c13e2d0e958fb3 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864740.347881:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000915f783c/0xf8c13e2d0e958fb3 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788864740.347888:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:1.0:1788864740.350039:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000915f783c/0xf8c13e2d0e958fb3 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.350069:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000915f783c/0xf8c13e2d0e958fb3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.350094:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864740.350446:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ecb4db95 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+9:3301:x1875760546583424:12345-0@lo:103: Request processed in 3008us (3178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864740.350475:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788864740.350515:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008b10bfc9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546583424:0@lo:103: 00000100:00100000:2.0:1788864740.388283:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ab7c7490 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+8:6679:x1875760546582656:12345-0@lo:253: Request processed in 55136us (55366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864740.388298:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788864740.388418:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000082730b1d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546582656:0@lo:253: 10000000:01000000:0.0:1788864740.388434:0:6679:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788864740.388438:0:6679:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788864740.388439:0:6679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788864740.388441:0:6679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788864740.388442:0:6679:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788864740.388443:0:6679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788864740.388444:0:6679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788864740.388445:0:6679:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788864740.388447:0:6679:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788864740.388449:0:6679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788864740.388450:0:6679:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788864740.388466:0:6679:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004e6ef46f from lustre-OST0000 10000000:01000000:0.0:1788864740.388488:0:6679:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788864740.388490:0:6679:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788864740.388496:0:6679:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fdca1ff4d40 local copy 10000000:01000000:0.0:1788864740.388500:0:6679:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788864740.388533:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000f02eab23/0xf8c13e2d0e958fba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864740.388543:0:6679:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.113@tcp lock: 00000000f02eab23/0xf8c13e2d0e958fba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864740.388551:0:6679:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000f02eab23/0xf8c13e2d0e958fba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864740.388792:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004dd0b703 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546583552:0@lo:101: 00000100:00100000:0.0:1788864740.388827:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864740.388961:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd32c78b going to sleep for 11 seconds 00000100:00100000:3.0:1788864740.389145:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546583552 00000100:00100000:3.0:1788864740.389152:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546583552 00000100:00100000:3.0:1788864740.389227:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788864740.389235:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001f0084c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+8:6679:x1875760546583552:12345-0@lo:101: 00010000:00010000:3.0:1788864740.389247:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864740.389259:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004d3bd76d/0xf8c13e2d0e958fc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e958fba expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.389279:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004d3bd76d/0xf8c13e2d0e958fc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e958fba expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.389288:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004d3bd76d/0xf8c13e2d0e958fc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e958fba expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.389295:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004d3bd76d, rc 0) 00000100:00100000:3.0:1788864740.389334:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001f0084c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+9:6679:x1875760546583552:12345-0@lo:101: Request processed in 100us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864740.389348:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788864740.389415:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004dd0b703 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546583552:0@lo:101: 00010000:00010000:1.0:1788864740.389428:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000f02eab23/0xf8c13e2d0e958fba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf8c13e2d0e958fc1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.389435:0:6679:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000f02eab23/0xf8c13e2d0e958fba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf8c13e2d0e958fc1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864740.389534:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce597093 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546583680:0@lo:501: 00000100:00100000:1.0:1788864740.389572:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864740.389814:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2ba81d0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864740.389905:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546583680 00000100:00100000:0.0:1788864740.389909:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546583680 00000100:00100000:0.0:1788864740.389929:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788864740.389935:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000213483d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+9:6679:x1875760546583680:12345-0@lo:501: 00000100:00100000:0.0:1788864740.390192:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000213483d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+9:6679:x1875760546583680:12345-0@lo:501: Request processed in 258us (630us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788864740.390199:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788864740.390315:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce597093 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546583680:0@lo:501: 10000000:01000000:1.0:1788864740.390331:0:6679:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788864740.390356:0:6679:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788864740.390360:0:6679:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000f02eab23/0xf8c13e2d0e958fba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf8c13e2d0e958fc1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.390368:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000f02eab23/0xf8c13e2d0e958fba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf8c13e2d0e958fc1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.390374:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: 00000000f02eab23/0xf8c13e2d0e958fba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf8c13e2d0e958fc1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.390399:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788864740.390418:0:6679:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fdcacbf0000 10000000:01000000:1.0:1788864740.390423:0:6679:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788864740.390426:0:6679:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9fdca1ff4d40 10000000:01000000:1.0:1788864740.390444:0:6679:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788864740.390447:0:6679:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9fdca1ff4d40 from 1 10000000:01000000:1.0:1788864740.390450:0:6679:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788864740.390469:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000c1638fc1/0xf8c13e2d0e958fc8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.390476:0:6679:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000c1638fc1/0xf8c13e2d0e958fc8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.390483:0:6679:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000c1638fc1/0xf8c13e2d0e958fc8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864740.390495:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce597093 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546583808:0@lo:101: 00000100:00100000:1.0:1788864740.390519:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864740.390532:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set 0000000082f78b28 going to sleep for 11 seconds 00010000:00010000:0.0:1788864740.390719:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864740.390724:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 00000000f02eab23/0xf8c13e2d0e958fba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf8c13e2d0e958fc1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864740.390732:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f02eab23 already unused, calling callback (00000000051492a5) 10000000:00010000:0.0:1788864740.390735:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 00000000f02eab23/0xf8c13e2d0e958fba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf8c13e2d0e958fc1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864740.390741:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 00000000f02eab23/0xf8c13e2d0e958fba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xf8c13e2d0e958fc1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788864740.390747:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 00000000f02eab23/0xf8c13e2d0e958fba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xf8c13e2d0e958fc1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864740.390752:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788864740.390769:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 00000000f02eab23/0xf8c13e2d0e958fba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf8c13e2d0e958fc1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864740.390774:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788864740.390821:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a4bfc9d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546583936:0@lo:103: 00000100:00100000:1.0:1788864740.390849:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788864740.390894:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 00000000f02eab23/0xf8c13e2d0e958fba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf8c13e2d0e958fc1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864740.390902:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 00000000f02eab23/0xf8c13e2d0e958fba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf8c13e2d0e958fc1 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864740.390915:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864740.390917:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864740.390925:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864740.390934:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546583808 00000100:00100000:0.0:1788864740.390939:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546583808 00000100:00100000:0.0:1788864740.390958:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788864740.390963:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e7c3de8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+9:6679:x1875760546583808:12345-0@lo:101: 00010000:00010000:0.0:1788864740.390971:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864740.390980:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009a478c64/0xf8c13e2d0e958fcf lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e958fc8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864740.390995:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009a478c64/0xf8c13e2d0e958fcf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e958fc8 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864740.391015:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009a478c64/0xf8c13e2d0e958fcf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e958fc8 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864740.391023:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009a478c64, rc 0) 00000100:00100000:0.0:1788864740.391052:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e7c3de8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+10:6679:x1875760546583808:12345-0@lo:101: Request processed in 89us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864740.391066:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788864740.391360:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546583936 00000100:00100000:1.0:1788864740.391365:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546583936 00000100:00100000:1.0:1788864740.391432:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788864740.391439:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eed5b0e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+10:3301:x1875760546583936:12345-0@lo:103: 00010000:00010000:1.0:1788864740.391447:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864740.391456:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004d3bd76d/0xf8c13e2d0e958fc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf8c13e2d0e958fba expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.391468:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864740.391533:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eed5b0e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+9:3301:x1875760546583936:12345-0@lo:103: Request processed in 95us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864740.391539:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788864740.391858:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a4bfc9d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546583936:0@lo:103: 00000100:00100000:1.0:1788864740.391929:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce597093 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546583808:0@lo:101: 00010000:00010000:1.0:1788864740.391942:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000c1638fc1/0xf8c13e2d0e958fc8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958fcf expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.391950:0:6679:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000c1638fc1/0xf8c13e2d0e958fc8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e958fcf expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788864740.391963:0:6679:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788864740.391984:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000c1638fc1/0xf8c13e2d0e958fc8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958fcf expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.391991:0:6679:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000c1638fc1/0xf8c13e2d0e958fc8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958fcf expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788864740.391998:0:6679:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788864740.392347:0:6679:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788864740.392352:0:6679:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788864740.392355:0:6679:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788864740.392375:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 000000005c28c077/0xf8c13e2d0e958fd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.392382:0:6679:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 000000005c28c077/0xf8c13e2d0e958fd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.392389:0:6679:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 000000005c28c077/0xf8c13e2d0e958fd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864740.392402:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce597093 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546584064:0@lo:101: 00000100:00100000:1.0:1788864740.392435:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864740.392505:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set 0000000082f78b28 going to sleep for 11 seconds 00000100:00100000:0.0:1788864740.392937:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546584064 00000100:00100000:0.0:1788864740.392943:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546584064 00000100:00100000:0.0:1788864740.393092:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788864740.393100:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005a89be29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+9:6679:x1875760546584064:12345-0@lo:101: 00010000:00010000:0.0:1788864740.393112:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864740.393123:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005f3e9af8/0xf8c13e2d0e958fdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e958fd6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864740.393140:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005f3e9af8/0xf8c13e2d0e958fdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e958fd6 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864740.393156:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005f3e9af8/0xf8c13e2d0e958fdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e958fd6 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864740.393163:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005f3e9af8, rc 0) 00000100:00100000:0.0:1788864740.393242:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005a89be29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+10:6679:x1875760546584064:12345-0@lo:101: Request processed in 143us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864740.393248:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788864740.393322:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce597093 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546584064:0@lo:101: 00010000:00010000:1.0:1788864740.393335:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 000000005c28c077/0xf8c13e2d0e958fd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958fdd expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.393342:0:6679:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 000000005c28c077/0xf8c13e2d0e958fd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e958fdd expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864740.393425:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce597093 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546584192:0@lo:501: 00000100:00100000:1.0:1788864740.393450:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864740.393479:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set 0000000082f78b28 going to sleep for 11 seconds 00000100:00100000:2.0:1788864740.393529:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546584192 00000100:00100000:2.0:1788864740.393534:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546584192 00000100:00100000:2.0:1788864740.393604:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788864740.393611:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b2d61e12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+10:6679:x1875760546584192:12345-0@lo:501: 00000100:00100000:2.0:1788864740.393984:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b2d61e12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+10:6679:x1875760546584192:12345-0@lo:501: Request processed in 374us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864740.393991:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788864740.394095:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce597093 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546584192:0@lo:501: 00000100:00100000:1.0:1788864740.394120:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce597093 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546584320:0@lo:503: 00000100:00100000:1.0:1788864740.394157:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864740.394272:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set 0000000082f78b28 going to sleep for 11 seconds 00000100:00100000:2.0:1788864740.394310:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546584320 00000100:00100000:2.0:1788864740.394314:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546584320 00000100:00100000:2.0:1788864740.394332:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788864740.394337:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fd670be2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+10:6679:x1875760546584320:12345-0@lo:503: 00000100:00100000:2.0:1788864740.394474:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fd670be2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+10:6679:x1875760546584320:12345-0@lo:503: Request processed in 137us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864740.394481:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788864740.394552:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce597093 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546584320:0@lo:503: 00000040:00080000:1.0:1788864740.394927:0:6679:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788864740.395066:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce597093 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546584448:0@lo:502: 00000100:00100000:1.0:1788864740.395107:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864740.395128:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set 0000000082f78b28 going to sleep for 11 seconds 00000100:00100000:2.0:1788864740.395178:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546584448 00000100:00100000:2.0:1788864740.395183:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546584448 00000100:00100000:2.0:1788864740.395202:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788864740.395207:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ea7a6a9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+10:6679:x1875760546584448:12345-0@lo:502: 00000100:00100000:2.0:1788864740.395343:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ea7a6a9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+10:6679:x1875760546584448:12345-0@lo:502: Request processed in 135us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864740.395349:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788864740.395413:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce597093 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546584448:0@lo:502: 00000040:00080000:1.0:1788864740.395814:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788864740.395864:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788864740.395896:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788864740.395953:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788864740.395988:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788864740.396152:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788864740.396178:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce597093 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546584576:0@lo:502: 00000100:00100000:1.0:1788864740.396222:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864740.396321:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set 0000000082f78b28 going to sleep for 11 seconds 00000100:00100000:0.0:1788864740.396650:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546584576 00000100:00100000:0.0:1788864740.396657:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546584576 00000100:00100000:0.0:1788864740.396684:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788864740.396689:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e947f941 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+10:6679:x1875760546584576:12345-0@lo:502: 00000100:00100000:0.0:1788864740.396869:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e947f941 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+10:6679:x1875760546584576:12345-0@lo:502: Request processed in 179us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864740.396876:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788864740.397038:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce597093 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546584576:0@lo:502: 00000040:00080000:1.0:1788864740.397141:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788864740.397150:0:6679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1788864740.397607:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788864740.397614:0:6699:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788864740.397620:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864740.397622:0:6699:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788864740.397626:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788864740.397804:0:6699:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (0000000058afc80b) 00000020:00000080:1.0:1788864740.397823:0:6699:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788864740.397831:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788864740.397897:0:6699:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004e6ef46f from lustre-OST0000, refs=2 00080000:01000000:1.0:1788864740.397904:0:6699:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788864740.397917:0:6699:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf8c13e2d0e958feb 00010000:00010000:0.0:1788864740.406312:0:6699:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1788864740.406884:0:6699:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1788864740.409936:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788864740.410300:0:6699:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788864740.420449:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788864740.421003:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788864740.422795:0:6699:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788864740.422807:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788864740.422812:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864740.422814:0:6699:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788864740.422817:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788864740.422821:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864740.422822:0:6699:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788864740.422825:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788864740.422832:0:6699:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788864740.422880:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788864740.422883:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864740.422884:0:6699:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788864740.422887:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788864740.423178:0:6679:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788864740.423201:0:6679:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788864740.423220:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 000000005c28c077/0xf8c13e2d0e958fd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958fdd expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.423232:0:6679:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 000000005c28c077/0xf8c13e2d0e958fd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958fdd expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788864740.423239:0:6679:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fdcacbf0000 from 1 10000000:01000000:1.0:1788864740.423242:0:6679:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788864740.423275:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 000000003a853759/0xf8c13e2d0e958ff2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.423282:0:6679:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 000000003a853759/0xf8c13e2d0e958ff2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.423298:0:6679:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 000000003a853759/0xf8c13e2d0e958ff2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864740.423319:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce597093 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546584704:0@lo:101: 00000100:00100000:1.0:1788864740.423383:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864740.423433:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2ba81d0 going to sleep for 11 seconds 00000100:00100000:3.0:1788864740.423492:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546584704 00000100:00100000:3.0:1788864740.423500:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546584704 00000100:00100000:3.0:1788864740.423543:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788864740.423551:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000014dfba3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+10:6679:x1875760546584704:12345-0@lo:101: 00010000:00010000:3.0:1788864740.423571:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864740.423583:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000002e2bbb0/0xf8c13e2d0e958ff9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e958ff2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.423603:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000002e2bbb0/0xf8c13e2d0e958ff9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e958ff2 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.423612:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000002e2bbb0/0xf8c13e2d0e958ff9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e958ff2 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.423619:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000002e2bbb0, rc 0) 00000100:00100000:3.0:1788864740.423674:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000014dfba3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:6679:x1875760546584704:12345-0@lo:101: Request processed in 124us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864740.423679:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788864740.424143:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce597093 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546584704:0@lo:101: 00010000:00010000:1.0:1788864740.424159:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 000000003a853759/0xf8c13e2d0e958ff2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958ff9 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.424167:0:6679:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 000000003a853759/0xf8c13e2d0e958ff2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e958ff9 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864740.424259:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce597093 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546584832:0@lo:501: 00000100:00100000:1.0:1788864740.424291:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864740.424313:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2ba81d0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864740.424334:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546584832 00000100:00100000:1.0:1788864740.424339:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546584832 00000100:00100000:1.0:1788864740.424403:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788864740.424411:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000ed02bf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:6679:x1875760546584832:12345-0@lo:501: 00000100:00100000:1.0:1788864740.424643:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000ed02bf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:6679:x1875760546584832:12345-0@lo:501: Request processed in 224us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864740.424650:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788864740.424912:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce597093 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546584832:0@lo:501: 00000100:00100000:1.0:1788864740.424941:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce597093 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546584960:0@lo:503: 00000100:00100000:1.0:1788864740.424987:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864740.425127:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2ba81d0 going to sleep for 11 seconds 00000100:00100000:3.0:1788864740.425171:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546584960 00000100:00100000:3.0:1788864740.425175:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546584960 00000100:00100000:3.0:1788864740.425232:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788864740.425239:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c76946d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:6679:x1875760546584960:12345-0@lo:503: 00000100:00100000:3.0:1788864740.425625:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c76946d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:6679:x1875760546584960:12345-0@lo:503: Request processed in 323us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864740.425695:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788864740.425903:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce597093 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546584960:0@lo:503: 00000040:00080000:1.0:1788864740.426226:0:6679:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788864740.426294:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce597093 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546585088:0@lo:502: 00000100:00100000:1.0:1788864740.426336:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864740.426410:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2ba81d0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864740.431903:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546585088 00000100:00100000:2.0:1788864740.431917:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546585088 00000100:00100000:0.0:1788864740.432161:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788864740.432170:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fe4486 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:6679:x1875760546585088:12345-0@lo:502: 00000100:00100000:0.0:1788864740.432452:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fe4486 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:6679:x1875760546585088:12345-0@lo:502: Request processed in 284us (6116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864740.432460:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788864740.434093:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce597093 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546585088:0@lo:502: 00000040:00080000:2.0:1788864740.434404:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788864740.434461:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788864740.434497:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008644d95b pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546585216:0@lo:502: 00000100:00100000:2.0:1788864740.434579:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864740.435079:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e2d097b going to sleep for 11 seconds 00000100:00100000:3.0:1788864740.435182:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546585216 00000100:00100000:3.0:1788864740.435191:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546585216 00000100:00100000:3.0:1788864740.435235:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788864740.435242:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000067c0d51e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:6679:x1875760546585216:12345-0@lo:502: 00000100:00100000:3.0:1788864740.435476:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000067c0d51e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:6679:x1875760546585216:12345-0@lo:502: Request processed in 235us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864740.435484:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788864740.435914:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008644d95b pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546585216:0@lo:502: 00000040:00080000:0.0:1788864740.436197:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788864740.436210:0:6679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788864740.437235:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788864740.437245:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864740.437247:0:6703:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788864740.437253:0:6703:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fdcacbf0000 00000020:00000080:2.0:1788864740.437255:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788864740.437293:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864740.437297:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864740.437298:0:6703:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788864740.437301:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788864740.437449:0:6679:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788864740.437472:0:6679:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788864740.437521:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14600/0xf8c13e2d0e958ff2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958ff9 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864740.437533:0:6679:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14600/0xf8c13e2d0e958ff2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958ff9 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864740.437776:0:6679:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788864740.437779:0:6679:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fdcacbf0000 10000000:01000000:0.0:1788864740.437783:0:6679:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fdcacbf0000 10000000:01000000:0.0:1788864740.437787:0:6679:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788864740.437792:0:6679:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fdcacbf0000 from 1 10000000:01000000:0.0:1788864740.437795:0:6679:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788864740.437829:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdc80031200/0xf8c13e2d0e959000 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864740.437837:0:6679:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdc80031200/0xf8c13e2d0e959000 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864740.437860:0:6679:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdc80031200/0xf8c13e2d0e959000 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864740.437880:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546585344:0@lo:101: 00000100:00100000:0.0:1788864740.437932:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864740.437958:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbff68e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788864740.438103:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546585344 00000100:00100000:3.0:1788864740.438110:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546585344 00000100:00100000:3.0:1788864740.438151:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788864740.438160:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:6679:x1875760546585344:12345-0@lo:101: 00010000:00010000:3.0:1788864740.438171:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864740.438183:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdc81497c00/0xf8c13e2d0e959007 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e959000 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.438206:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdc81497c00/0xf8c13e2d0e959007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e959000 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.438216:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdc81497c00/0xf8c13e2d0e959007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e959000 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.438224:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdc81497c00, rc 0) 00000100:00100000:3.0:1788864740.438307:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:6679:x1875760546585344:12345-0@lo:101: Request processed in 147us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864740.438314:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788864740.438442:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546585344:0@lo:101: 00010000:00010000:1.0:1788864740.438456:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdc80031200/0xf8c13e2d0e959000 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959007 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.438464:0:6679:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdc80031200/0xf8c13e2d0e959000 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e959007 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864740.438545:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546585472:0@lo:501: 00000100:00100000:1.0:1788864740.438829:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864740.438892:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcac9b3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788864740.438926:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546585472 00000100:00100000:3.0:1788864740.438931:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546585472 00000100:00100000:3.0:1788864740.438986:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788864740.438993:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:6679:x1875760546585472:12345-0@lo:501: 00000100:00100000:3.0:1788864740.439288:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:6679:x1875760546585472:12345-0@lo:501: Request processed in 294us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864740.439302:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788864740.439361:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546585472:0@lo:501: 00000100:00100000:1.0:1788864740.439392:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546585600:0@lo:503: 00000100:00100000:1.0:1788864740.439428:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864740.439500:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcac9b3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788864740.439555:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546585600 00000100:00100000:0.0:1788864740.439560:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546585600 00000100:00100000:0.0:1788864740.439591:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788864740.439598:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:6679:x1875760546585600:12345-0@lo:503: 00000100:00100000:0.0:1788864740.439782:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:6679:x1875760546585600:12345-0@lo:503: Request processed in 184us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864740.439789:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788864740.439937:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546585600:0@lo:503: 00000040:00080000:1.0:1788864740.440209:0:6679:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788864740.440262:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546585728:0@lo:502: 00000100:00100000:1.0:1788864740.440292:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864740.440318:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcac9b3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788864740.440473:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546585728 00000100:00100000:0.0:1788864740.440478:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546585728 00000100:00100000:0.0:1788864740.440495:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788864740.440501:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:6679:x1875760546585728:12345-0@lo:502: 00000100:00100000:0.0:1788864740.440807:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:6679:x1875760546585728:12345-0@lo:502: Request processed in 305us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864740.440814:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788864740.440877:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546585728:0@lo:502: 00000040:00080000:1.0:1788864740.441131:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788864740.441171:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788864740.441198:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788864740.441246:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788864740.441275:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788864740.441312:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788864740.441346:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788864740.441392:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788864740.441438:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788864740.441475:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788864740.441508:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788864740.441570:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788864740.441606:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788864740.441631:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788864740.441881:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788864740.441913:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788864740.441940:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788864740.441990:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788864740.442040:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788864740.442096:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788864740.442136:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788864740.442164:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788864740.442190:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788864740.442225:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788864740.442253:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788864740.442277:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788864740.442315:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788864740.442363:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1788864740.442398:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546585856:0@lo:502: 00000100:00100000:1.0:1788864740.442448:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864740.442486:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcac9b3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788864740.442625:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546585856 00000100:00100000:0.0:1788864740.442632:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546585856 00000100:00100000:0.0:1788864740.442777:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788864740.442785:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:6679:x1875760546585856:12345-0@lo:502: 00000100:00100000:0.0:1788864740.445261:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:6679:x1875760546585856:12345-0@lo:502: Request processed in 2468us (2804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864740.445289:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788864740.445420:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546585856:0@lo:502: 00000040:00080000:1.0:1788864740.445526:0:6679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788864740.445540:0:6679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788864740.446549:0:6704:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788864740.446628:0:6704:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9fdca1ff0000) 00000020:00000080:3.0:1788864740.446807:0:6704:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788864740.446890:0:6704:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fdcacbf0000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788864740.446895:0:6704:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fdcacbf0000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788864740.446897:0:6704:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fdcacbf0000 3 00010000:00080000:3.0:1788864740.446924:0:6704:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fdb81805000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.113@tcp at head 00010000:00010000:3.0:1788864740.449418:0:6704:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1788864740.449911:0:6704:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788864740.449947:0:6704:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788864740.449958:0:6704:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf8c13e2d0e959015 00000100:00080000:3.0:1788864740.449967:0:6704:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788864740.449977:0:6704:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fdb81805000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788864740.450696:0:6704:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fdca003c000 x1875760546585984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788864740.450747:0:6704:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788864740.450814:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546586112:0@lo:400: 00000100:00100000:3.0:1788864740.450873:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864740.450938:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546586112 00000100:00100000:3.0:1788864740.450945:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546586112 00000100:00100000:3.0:1788864740.450984:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788864740.450994:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546586112:12345-0@lo:400: 00000100:00100000:2.0:1788864740.451168:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875760546585984:0@lo:38: 00000100:00100000:2.0:1788864740.451201:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864740.451265:0:5837:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788864740.451274:0:5837:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788864740.452173:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546586112:12345-0@lo:400: Request processed in 1177us (1296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864740.452182:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788864740.452201:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546585984 00000100:00100000:3.0:1788864740.452214:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546585984 00000100:00100000:3.0:1788864740.452233:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788864740.452238:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875760546585984:12345-0@lo:38: 00010000:00080000:3.0:1788864740.452273:0:5835:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 163 last 0 00000020:00000080:3.0:1788864740.452308:0:5835:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf8c13e2d0e95901c 00000004:00100000:3.0:1788864740.452323:0:5835:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788864740.452352:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9fdb81806000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788864740.452392:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875760546585984:12345-0@lo:38: Request processed in 153us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864740.452398:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788864740.452439:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fdca003c000 x1875760546585984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788864750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864740.452448:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788864740.452455:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788864740.452462:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788864740.452466:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788864740.452468:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fdb81805000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788864740.452474:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875760546585984:0@lo:38: 00010000:00080000:3.0:1788864740.452505:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fdca003df80 x1875760546586112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864740.452515:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546586112:0@lo:400: 00000040:00080000:2.0:1788864740.455942:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1788864740.456818:0:6679:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1788864740.456844:0:6679:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788864740.456870:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdc80031200/0xf8c13e2d0e959000 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959007 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.456883:0:6679:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdc80031200/0xf8c13e2d0e959000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959007 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788864740.456950:0:6679:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788864740.456952:0:6679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788864740.456954:0:6679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788864740.456955:0:6679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788864740.456956:0:6679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788864740.456958:0:6679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788864740.456960:0:6679:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788864740.457167:0:6679:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788864740.457169:0:6679:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788864740.457171:0:6679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788864740.457173:0:6679:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788864740.457177:0:6679:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788864740.457180:0:6679:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788864740.457182:0:6679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788864740.457183:0:6679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788864740.457184:0:6679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788864740.457186:0:6679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788864740.457187:0:6679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788864740.457189:0:6679:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788864740.457190:0:6679:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788864740.457191:0:6679:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788864740.457192:0:6679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788864740.457193:0:6679:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788864740.457217:0:6679:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788864740.457240:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546586240:0@lo:253: 00000100:00100000:1.0:1788864740.457323:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864740.457369:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcac9b3780 going to sleep for 11 seconds 00000100:00100000:0.0:1788864740.457375:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546586240 00000100:00100000:0.0:1788864740.457383:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546586240 00000100:00100000:0.0:1788864740.457435:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788864740.457448:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:6679:x1875760546586240:12345-0@lo:253: 20000000:01000000:0.0:1788864740.457473:0:5830:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788864740.457484:0:5830:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788864740.486435:0:5830:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788864740.486482:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788864740.486567:0:5851:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788864740.486573:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788864740.486592:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959023 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864740.486610:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdca4d15a00/0xf8c13e2d0e958f90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e958f89 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864740.486617:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959023 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864740.486663:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdca4d15a00/0xf8c13e2d0e958f90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e958f89 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864740.486678:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fdca4d15a00/0xf8c13e2d0e958f90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e958f89 expref: 12 pid: 5828 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864740.486738:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1875760546586368:0@lo:104: 00000100:00100000:2.0:1788864740.486799:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864740.486885:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca15050c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788864740.486969:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546586368 00000100:00100000:3.0:1788864740.486978:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546586368 00000100:00100000:3.0:1788864740.487027:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788864740.487035:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+3:5851:x1875760546586368:12345-0@lo:104: 00010000:00010000:3.0:1788864740.487047:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044400/0xf8c13e2d0e958f89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e958f90 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.487119:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788864740.487126:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+3:5851:x1875760546586368:12345-0@lo:104: Request processed in 92us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864740.487133:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788864740.487152:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788864740.487158:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044400/0xf8c13e2d0e958f89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e958f90 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.487166:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc2044400 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:3.0:1788864740.487170:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044400/0xf8c13e2d0e958f89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e958f90 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.487177:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044400/0xf8c13e2d0e958f89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e958f90 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788864740.487184:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044400/0xf8c13e2d0e958f89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e958f90 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864740.487189:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788864740.487213:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044400/0xf8c13e2d0e958f89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e958f90 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.487219:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788864740.487235:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044400/0xf8c13e2d0e958f89 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e958f90 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.487241:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044400/0xf8c13e2d0e958f89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e958f90 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864740.487266:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864740.487268:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864740.487269:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864740.487281:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546586496:0@lo:103: 00000100:00100000:3.0:1788864740.487314:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864740.487543:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1875760546586368:0@lo:104: 00010000:00010000:2.0:1788864740.487559:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959023 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864740.489921:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546586496 00000100:00100000:1.0:1788864740.489935:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546586496 00010000:00010000:1.0:1788864740.489975:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdca4d15a00/0xf8c13e2d0e958f90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e958f89 expref: 13 pid: 5828 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864740.490026:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788864740.490035:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1e52050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:3303:x1875760546586496:12345-0@lo:103: 00010000:00010000:1.0:1788864740.490049:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864740.490054:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdca4d15a00/0xf8c13e2d0e958f90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e958f89 expref: 13 pid: 5828 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.490077:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdca4d15a00/0xf8c13e2d0e958f90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e958f89 expref: 13 pid: 5828 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.490095:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdca4d15a00/0xf8c13e2d0e958f90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e958f89 expref: 13 pid: 5828 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.490112:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959023 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.490120:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959023 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788864740.490136:0:5822:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003564278s 00010000:00010000:1.0:1788864740.490141:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959023 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.490147:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959023 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.490169:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959023 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.490176:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959023 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.490182:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc2044e00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788864740.490186:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959023 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.490195:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959023 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.490211:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959023 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.490222:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864740.490284:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1e52050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:3303:x1875760546586496:12345-0@lo:103: Request processed in 251us (2969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864740.490291:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788864740.490364:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546586496:0@lo:103: 00010000:00010000:1.0:1788864740.490389:0:5851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959023 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.490396:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959023 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864740.490402:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959023 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864740.499405:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:6679:x1875760546586240:12345-0@lo:253: Request processed in 41953us (42074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864740.499419:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788864740.499537:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6679:1875760546586240:0@lo:253: 10000000:01000000:3.0:1788864740.499553:0:6679:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788864740.499557:0:6679:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788864740.499567:0:6679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788864740.499569:0:6679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788864740.499570:0:6679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788864740.499571:0:6679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788864740.499573:0:6679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788864740.499574:0:6679:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788864740.499575:0:6679:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788864740.499577:0:6679:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788864740.499578:0:6679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788864740.499580:0:6679:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788864740.499593:0:6679:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788864740.505966:0:6679:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788864740.506224:0:6679:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788864740.506438:0:6679:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788864740.506911:0:6679:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788864740.507173:0:6679:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788864740.507391:0:6679:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788864740.508427:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788864740.692954:0:6679:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788864740.692965:0:6679:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788864740.693009:0:6679:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788864740.693082:0:6679:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788864740.693099:0:6679:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788864740.693118:0:6679:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788864740.933078:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864741.956885:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864742.988614:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788864743.430417:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788864743.430424:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fdc8878e000 from 21 10000000:01000000:2.0:1788864743.430428:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788864743.430543:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95902a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864743.430555:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95902a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864743.430567:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95902a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864743.430590:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546586624:0@lo:101: 00000100:00100000:2.0:1788864743.430659:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864743.430764:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1ab6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788864743.430889:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546586624 00000100:00100000:0.0:1788864743.430897:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546586624 00000100:00100000:0.0:1788864743.430986:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788864743.430996:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:5832:x1875760546586624:12345-0@lo:101: 00010000:00010000:0.0:1788864743.431025:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864743.431045:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdc80030000/0xf8c13e2d0e959031 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95902a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864743.431068:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdc80030000/0xf8c13e2d0e959031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95902a expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864743.431091:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdc80030000/0xf8c13e2d0e959031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95902a expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864743.431099:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdc80030000, rc 0) 00000100:00100000:0.0:1788864743.431143:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:5832:x1875760546586624:12345-0@lo:101: Request processed in 149us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864743.431149:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788864743.431220:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546586624:0@lo:101: 00010000:00010000:1.0:1788864743.431235:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95902a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959031 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864743.431243:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95902a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e959031 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864743.431299:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546586752:0@lo:501: 00000100:00100000:1.0:1788864743.433243:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864743.433428:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcb53036c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864743.433477:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546586752 00000100:00100000:0.0:1788864743.433486:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546586752 00000100:00100000:0.0:1788864743.433621:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788864743.433635:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:5832:x1875760546586752:12345-0@lo:501: 00000100:00100000:1.0:1788864743.434728:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:5832:x1875760546586752:12345-0@lo:501: Request processed in 1070us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864743.434738:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788864743.434966:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546586752:0@lo:501: 00000100:00100000:0.0:1788864743.435020:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546586880:0@lo:503: 00000100:00100000:0.0:1788864743.435073:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864743.435136:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc83366a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788864743.435641:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546586880 00000100:00100000:1.0:1788864743.435659:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546586880 00000100:00100000:1.0:1788864743.435783:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788864743.435794:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:5832:x1875760546586880:12345-0@lo:503: 00000100:00100000:1.0:1788864743.435994:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:5832:x1875760546586880:12345-0@lo:503: Request processed in 203us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864743.436002:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788864743.436027:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546586880:0@lo:503: 00000100:00100000:0.0:1788864743.436220:0:6883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6883:1875760546587008:0@lo:502: 00000100:00100000:0.0:1788864743.436258:0:6883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864743.441885:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546587008 00000100:00100000:2.0:1788864743.441898:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546587008 00000100:00100000:2.0:1788864743.441954:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788864743.441964:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:6883:x1875760546587008:12345-0@lo:502: 00000100:00100000:0.0:1788864743.442104:0:6883:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc83366cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864743.442228:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:6883:x1875760546587008:12345-0@lo:502: Request processed in 265us (5968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864743.442242:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788864743.442366:0:6883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6883:1875760546587008:0@lo:502: 00000100:00100000:0.0:1788864743.442433:0:6883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6883:1875760546587136:0@lo:502: 00000100:00100000:0.0:1788864743.442478:0:6883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864743.442503:0:6883:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc83366cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864743.442585:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546587136 00000100:00100000:2.0:1788864743.442590:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546587136 00000100:00100000:2.0:1788864743.442618:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788864743.442624:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:6883:x1875760546587136:12345-0@lo:502: 00000100:00100000:2.0:1788864743.443048:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:6883:x1875760546587136:12345-0@lo:502: Request processed in 413us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864743.443056:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788864743.443130:0:6883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6883:1875760546587136:0@lo:502: 00000040:00080000:1.0:1788864743.443154:0:6883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788864743.443401:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788864743.443427:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788864743.443436:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95902a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959031 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864743.443447:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95902a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959031 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864743.443456:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788864743.443458:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fdc8878e000 from 4 10000000:01000000:0.0:1788864743.443461:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788864743.443490:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959038 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864743.443498:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959038 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864743.443508:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959038 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864743.443522:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546587264:0@lo:101: 00000100:00100000:0.0:1788864743.443552:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864743.443583:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc83366840 going to sleep for 11 seconds 00000100:00100000:1.0:1788864743.443612:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546587264 00000100:00100000:1.0:1788864743.443617:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546587264 00000100:00100000:1.0:1788864743.443916:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788864743.443926:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:5832:x1875760546587264:12345-0@lo:101: 00010000:00010000:1.0:1788864743.443943:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864743.443957:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdca4d14800/0xf8c13e2d0e95903f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e959038 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864743.443976:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdca4d14800/0xf8c13e2d0e95903f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e959038 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864743.443987:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdca4d14800/0xf8c13e2d0e95903f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e959038 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864743.443994:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca4d14800, rc 0) 00000100:00100000:1.0:1788864743.444033:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:5832:x1875760546587264:12345-0@lo:101: Request processed in 110us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864743.444050:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788864743.444088:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546587264:0@lo:101: 00010000:00010000:0.0:1788864743.444105:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959038 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95903f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864743.444116:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959038 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95903f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864743.444159:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546587392:0@lo:256: 00000100:00100000:0.0:1788864743.444195:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864743.444224:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc83366840 going to sleep for 11 seconds 00000100:00100000:2.0:1788864743.444287:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546587392 00000100:00100000:2.0:1788864743.444292:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546587392 00000100:00100000:2.0:1788864743.444320:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788864743.444327:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:5832:x1875760546587392:12345-0@lo:256: 20000000:01000000:2.0:1788864743.444339:0:5828:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788864743.444354:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788864743.444358:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788864743.444448:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:5832:x1875760546587392:12345-0@lo:256: Request processed in 121us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864743.444457:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788864743.445051:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546587392:0@lo:256: 10000000:01000000:0.0:1788864743.445092:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788864743.445099:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959038 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95903f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864743.445109:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959038 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95903f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864743.445117:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788864743.445120:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788864743.445122:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788864743.445140:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdc80030200/0xf8c13e2d0e959046 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864743.445147:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdc80030200/0xf8c13e2d0e959046 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864743.445154:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdc80030200/0xf8c13e2d0e959046 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864743.445167:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546587520:0@lo:101: 00000100:00100000:0.0:1788864743.445200:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864743.445231:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc83366840 going to sleep for 11 seconds 00000100:00100000:1.0:1788864743.445242:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546587520 00000100:00100000:1.0:1788864743.445248:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546587520 00000100:00100000:1.0:1788864743.445280:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788864743.445287:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:5832:x1875760546587520:12345-0@lo:101: 00010000:00010000:1.0:1788864743.445296:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864743.445306:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdca4d15a00/0xf8c13e2d0e95904d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e959046 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864743.445324:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdca4d15a00/0xf8c13e2d0e95904d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e959046 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864743.445333:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdca4d15a00/0xf8c13e2d0e95904d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e959046 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864743.445340:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca4d15a00, rc 0) 00000100:00100000:1.0:1788864743.445389:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:5832:x1875760546587520:12345-0@lo:101: Request processed in 102us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864743.445395:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788864743.446161:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546587520:0@lo:101: 00010000:00010000:0.0:1788864743.446179:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdc80030200/0xf8c13e2d0e959046 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95904d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864743.446202:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdc80030200/0xf8c13e2d0e959046 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95904d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864743.446256:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546587648:0@lo:501: 00000100:00100000:0.0:1788864743.446300:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864743.446323:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc83366840 going to sleep for 11 seconds 00000100:00100000:1.0:1788864743.446957:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546587648 00000100:00100000:1.0:1788864743.446965:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546587648 00000100:00100000:1.0:1788864743.447006:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788864743.447014:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:5832:x1875760546587648:12345-0@lo:501: 00000100:00100000:1.0:1788864743.447277:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:5832:x1875760546587648:12345-0@lo:501: Request processed in 263us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864743.447285:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788864743.447316:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546587648:0@lo:501: 00000100:00100000:2.0:1788864743.447352:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546587776:0@lo:503: 00000100:00100000:2.0:1788864743.447393:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864743.447416:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546587776 00000100:00100000:3.0:1788864743.447422:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546587776 00000100:00100000:2.0:1788864743.447427:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1ab6480 going to sleep for 11 seconds 00000100:00100000:3.0:1788864743.447469:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788864743.447476:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:5832:x1875760546587776:12345-0@lo:503: 00000100:00100000:3.0:1788864743.447864:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:5832:x1875760546587776:12345-0@lo:503: Request processed in 388us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864743.447872:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788864743.447920:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546587776:0@lo:503: 00000100:00100000:1.0:1788864743.449854:0:6885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6885:1875760546587904:0@lo:502: 00000100:00100000:1.0:1788864743.449916:0:6885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864743.449949:0:6885:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca0d35780 going to sleep for 11 seconds 00000100:00100000:0.0:1788864743.450468:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546587904 00000100:00100000:0.0:1788864743.450476:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546587904 00000100:00100000:0.0:1788864743.450524:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788864743.450534:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:6885:x1875760546587904:12345-0@lo:502: 00000100:00100000:0.0:1788864743.450841:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:6885:x1875760546587904:12345-0@lo:502: Request processed in 308us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864743.450848:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788864743.450991:0:6885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6885:1875760546587904:0@lo:502: 00000020:01000000:3.0:1788864743.451030:0:6885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788864743.451049:0:6885:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788864743.451057:0:6885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864743.451060:0:6885:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788864743.451066:0:6885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788864743.451070:0:6885:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:3.0:1788864743.451092:0:6885:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788864743.451094:0:6885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788864743.451194:0:6885:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9fdc9099cd40) 00000020:00000080:3.0:1788864743.451211:0:6885:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788864743.451451:0:6885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788864743.451515:0:6885:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788864743.451519:0:6885:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788864743.451524:0:6885:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf8c13e2d0e95905b 00010000:00080000:3.0:1788864743.451546:0:6885:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fdca2cf9800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:3.0:1788864743.452228:0:6885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788864743.508502:0:6885:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788864743.508524:0:6885:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788864743.509141:0:6885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788864743.509305:0:6885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788864743.509349:0:6885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788864743.509398:0:6885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788864743.510086:0:6888:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788864743.510091:0:6888:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788864743.510830:0:6885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788864743.510840:0:6885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788864743.510874:0:6885:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788864743.510893:0:6885:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf8c13e2d0e959062 00000100:00080000:3.0:1788864743.510912:0:6885:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788864743.510923:0:6885:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fdca2cf9800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788864743.510954:0:6885:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fdca003c000 x1875760546588032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788864743.510978:0:6885:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788864743.511026:0:6885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788864743.511029:0:6885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864743.511031:0:6885:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788864743.511034:0:6885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788864743.511047:0:6885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864743.511049:0:6885:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788864743.511052:0:6885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788864743.511054:0:6885:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788864743.511076:0:6885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6885:1875760546588160:0@lo:502: 00000100:00100000:3.0:1788864743.511146:0:6885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864743.511183:0:6885:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcb7fe2480 going to sleep for 11 seconds 00000100:00100000:3.0:1788864743.511204:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546588160 00000100:00100000:3.0:1788864743.511209:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546588160 00000100:00100000:3.0:1788864743.511239:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788864743.511246:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:6885:x1875760546588160:12345-0@lo:502: 00000100:00100000:2.0:1788864743.511524:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875760546588032:0@lo:8: 00000100:00100000:2.0:1788864743.511780:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864743.511844:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546588288:0@lo:400: 00000100:00100000:0.0:1788864743.511884:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864743.511909:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788864743.511915:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546588416:0@lo:400: 00000100:00100000:0.0:1788864743.511941:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864743.511983:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546588288 00000100:00100000:0.0:1788864743.511988:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546588288 00000100:00100000:3.0:1788864743.511991:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:6885:x1875760546588160:12345-0@lo:502: Request processed in 743us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864743.512001:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788864743.512177:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546588416 00000100:00100000:0.0:1788864743.512182:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546588416 00000100:00100000:2.0:1788864743.512199:0:6885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6885:1875760546588160:0@lo:502: 00000020:01000000:2.0:1788864743.512234:0:6885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864743.512240:0:6885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864743.512242:0:6885:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788864743.512247:0:6885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:1.0:1788864743.512275:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546588032 00000100:00100000:1.0:1788864743.512282:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546588032 00000100:00100000:1.0:1788864743.512307:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788864743.512313:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1875760546588032:12345-0@lo:8: 00010000:00080000:1.0:1788864743.512336:0:6682:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:1.0:1788864743.512360:0:6682:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf8c13e2d0e959069 00002000:00100000:1.0:1788864743.512399:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9fdb8119a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788864743.512405:0:6682:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1788864743.512408:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788864743.512424:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:2.0:1788864743.512528:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 00002000:00100000:1.0:1788864743.512534:0:6682:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788864743.512541:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788864743.512553:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546588288:12345-0@lo:400: 10000000:01000000:2.0:1788864743.512566:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788864743.512577:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdc80030200/0xf8c13e2d0e959046 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95904d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864743.512587:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdc80030200/0xf8c13e2d0e959046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95904d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864743.512596:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788864743.512599:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fdc8878e000 from 1 00000100:00100000:0.0:1788864743.512603:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546588288:12345-0@lo:400: Request processed in 52us (716us total) trans 0 rc 0/0 10000000:01000000:2.0:1788864743.512604:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000100:00100000:0.0:1788864743.512625:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788864743.512632:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044400/0xf8c13e2d0e959070 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864743.512641:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044400/0xf8c13e2d0e959070 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864743.512643:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788864743.512655:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044400/0xf8c13e2d0e959070 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864743.512655:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546588416:12345-0@lo:400: 00000100:00100000:2.0:1788864743.512676:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546588544:0@lo:101: 00000100:00100000:0.0:1788864743.512694:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546588416:12345-0@lo:400: Request processed in 42us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864743.512726:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788864743.512741:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864743.512763:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc85e95c00 going to sleep for 11 seconds 00010000:00080000:0.0:1788864743.512778:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdcacbef800 x1875760546588416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864743.512789:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546588544 00000100:00100000:0.0:1788864743.512793:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546588416:0@lo:400: 00000100:00100000:2.0:1788864743.512795:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546588544 00010000:00080000:0.0:1788864743.512813:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdcacbece00 x1875760546588288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864743.512823:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546588288:0@lo:400: 00000100:00100000:2.0:1788864743.512830:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788864743.512841:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:5832:x1875760546588544:12345-0@lo:101: 00010000:00010000:2.0:1788864743.512849:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864743.512861:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959077 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e959070 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864743.512882:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e959070 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788864743.512885:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00010000:00010000:2.0:1788864743.512906:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e959070 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788864743.512910:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9fdb81198000 : changing import state from RECOVER to FULL 00010000:00010000:2.0:1788864743.512918:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcc2044e00, rc 0) 00000100:00100000:2.0:1788864743.512969:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:5832:x1875760546588544:12345-0@lo:101: Request processed in 131us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864743.512973:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1875760546588032:12345-0@lo:8: Request processed in 657us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864743.512979:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788864743.512995:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788864743.513021:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdca003c000 x1875760546588032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788864753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864743.513030:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788864743.513049:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788864743.513056:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788864743.513061:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788864743.513063:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fdca2cf9800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788864743.513080:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788864743.513087:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875760546588032:0@lo:8: 00000004:00080000:2.0:1788864743.513107:0:6888:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788864743.513234:0:6888:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 166644529005ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788864743.513586:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546588544:0@lo:101: 00010000:00010000:0.0:1788864743.513601:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044400/0xf8c13e2d0e959070 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959077 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864743.513612:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044400/0xf8c13e2d0e959070 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e959077 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864743.513657:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546588672:0@lo:501: 00000100:00100000:0.0:1788864743.513689:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864743.513745:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc83366840 going to sleep for 11 seconds 00000100:00100000:2.0:1788864743.513843:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546588672 00000100:00100000:2.0:1788864743.513848:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546588672 00000100:00100000:2.0:1788864743.513879:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788864743.513885:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:5832:x1875760546588672:12345-0@lo:501: 00000100:00100000:2.0:1788864743.514095:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:5832:x1875760546588672:12345-0@lo:501: Request processed in 210us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864743.514102:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788864743.514223:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546588672:0@lo:501: 00000100:00100000:0.0:1788864743.514253:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546588800:0@lo:503: 00000100:00100000:0.0:1788864743.514297:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864743.514328:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc83366840 going to sleep for 11 seconds 00000100:00100000:1.0:1788864743.515167:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546588800 00000100:00100000:1.0:1788864743.515175:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546588800 00000100:00100000:1.0:1788864743.515206:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788864743.515215:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:5832:x1875760546588800:12345-0@lo:503: 00000100:00100000:1.0:1788864743.516220:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:5832:x1875760546588800:12345-0@lo:503: Request processed in 1003us (1920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864743.516232:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788864743.516303:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546588800:0@lo:503: 00000100:00100000:2.0:1788864743.525572:0:6890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6890:1875760546588928:0@lo:502: 00000100:00100000:2.0:1788864743.525651:0:6890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864743.525690:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546588928 00000100:00100000:2.0:1788864743.525699:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546588928 00000100:00100000:2.0:1788864743.525830:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788864743.525840:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:6890:x1875760546588928:12345-0@lo:502: 00000100:00100000:2.0:1788864743.526278:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:6890:x1875760546588928:12345-0@lo:502: Request processed in 438us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864743.526286:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788864743.526351:0:6890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc85e953c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864743.526372:0:6890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6890:1875760546588928:0@lo:502: 00000020:01000000:2.0:1788864743.526400:0:6890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788864743.526409:0:6890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864743.526411:0:6890:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788864743.526420:0:6890:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fdc8878e000 00000020:00000080:2.0:1788864743.526423:0:6890:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788864743.526446:0:6890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6890:1875760546589056:0@lo:502: 00000100:00100000:2.0:1788864743.526480:0:6890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864743.526502:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546589056 00000100:00100000:2.0:1788864743.526512:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546589056 00000100:00100000:2.0:1788864743.526534:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788864743.526541:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:6890:x1875760546589056:12345-0@lo:502: 00000100:00100000:2.0:1788864743.526650:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:6890:x1875760546589056:12345-0@lo:502: Request processed in 108us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864743.526658:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788864743.526695:0:6890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc85e953c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864743.526732:0:6890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:6890:1875760546589056:0@lo:502: 00000020:01000000:2.0:1788864743.526969:0:6890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864743.526974:0:6890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864743.526976:0:6890:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788864743.526981:0:6890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788864743.527056:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788864743.527077:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788864743.527086:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044400/0xf8c13e2d0e959070 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959077 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864743.527099:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044400/0xf8c13e2d0e959070 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959077 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864743.527108:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788864743.527111:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fdca1ff4d40 from 1 10000000:01000000:0.0:1788864743.527113:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788864743.527135:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e95907e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864743.527143:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e95907e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864743.527152:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e95907e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864743.527165:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546589184:0@lo:101: 00000100:00100000:0.0:1788864743.527194:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864743.527219:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc83366840 going to sleep for 11 seconds 00000100:00100000:2.0:1788864743.527276:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546589184 00000100:00100000:2.0:1788864743.527281:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546589184 00000100:00100000:2.0:1788864743.527306:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788864743.527313:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eeb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:5832:x1875760546589184:12345-0@lo:101: 00010000:00010000:2.0:1788864743.527322:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864743.527334:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e959085 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95907e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864743.527355:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e959085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95907e expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864743.527365:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e959085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95907e expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864743.527374:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcc2044600, rc 0) 00000100:00100000:2.0:1788864743.527405:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eeb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:5832:x1875760546589184:12345-0@lo:101: Request processed in 92us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864743.527420:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788864743.527450:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546589184:0@lo:101: 00010000:00010000:2.0:1788864743.527462:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e95907e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959085 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864743.527471:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e95907e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e959085 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864743.527508:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546589312:0@lo:501: 00000100:00100000:2.0:1788864743.527532:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864743.527545:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc85e956c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864743.527597:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546589312 00000100:00100000:2.0:1788864743.527601:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546589312 00000100:00100000:2.0:1788864743.528687:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788864743.528697:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:5832:x1875760546589312:12345-0@lo:501: 00000100:00100000:2.0:1788864743.530077:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:5832:x1875760546589312:12345-0@lo:501: Request processed in 1378us (2541us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788864743.530089:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788864743.530140:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546589312:0@lo:501: 10000000:01000000:2.0:1788864743.530173:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788864743.530183:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e95907e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959085 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864743.530193:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e95907e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959085 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788864743.557968:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788864743.558234:0:6889:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788864743.558260:0:6889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6889:1875760546589568:0@lo:7: 00000100:00100000:1.0:1788864743.558396:0:6889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864743.558506:0:6889:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc87333600 going to sleep for 11 seconds 00000100:00100000:1.0:1788864743.558526:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546589440:0@lo:13: 00000100:00100000:1.0:1788864743.558608:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864743.558653:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546589568 00000100:00100000:1.0:1788864743.558659:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546589568 00000100:00100000:1.0:1788864743.558727:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788864743.558736:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbba7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6889:x1875760546589568:12345-0@lo:7: 00000100:00100000:0.0:1788864743.562225:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546589440 00000100:00100000:0.0:1788864743.562237:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546589440 00000100:00100000:0.0:1788864743.562285:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788864743.562295:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbba7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1875760546589440:12345-0@lo:13: 00002000:00000024:0.0:1788864743.562334:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788864743.562417:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbba7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1875760546589440:12345-0@lo:13: Request processed in 123us (3809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864743.562423:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788864743.578166:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788864743.579065:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdcbba7c000 x1875760546589440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864743.579092:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546589440:0@lo:13: 00002000:00080000:1.0:1788864743.584674:0:6685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788864743.584682:0:6685:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788864743.584919:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbba7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6889:x1875760546589568:12345-0@lo:7: Request processed in 26179us (26519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864743.584928:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788864743.585080:0:6889:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdcbba7d180 x1875760546589568/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788864759 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864743.585096:0:6889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6889:1875760546589568:0@lo:7: 00000004:00080000:3.0:1788864743.585115:0:6889:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788864743.585153:0:6889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6889:1875760546589696:0@lo:5: 00000100:00100000:3.0:1788864743.585184:0:6889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864743.585250:0:6889:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcb7fe2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788864743.585284:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546589696 00000100:00100000:1.0:1788864743.585290:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546589696 00000100:00100000:1.0:1788864743.585427:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788864743.585445:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6889:x1875760546589696:12345-0@lo:5: 00002000:00080000:1.0:1788864743.585467:0:6684:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788864743.585470:0:6684:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788864743.585844:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6889:x1875760546589696:12345-0@lo:5: Request processed in 408us (658us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788864743.585851:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788864743.586058:0:6889:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdca003dc00 x1875760546589696/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788864759 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864743.586071:0:6889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6889:1875760546589696:0@lo:5: 00000004:00080000:1.0:1788864743.586080:0:6889:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788864743.586105:0:6889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6889:1875760546589824:0@lo:700: 00000100:00100000:1.0:1788864743.586129:0:6889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864743.586182:0:6889:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc87333480 going to sleep for 11 seconds 00000100:00100000:0.0:1788864743.586216:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546589824 00000100:00100000:0.0:1788864743.586221:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546589824 00000100:00100000:0.0:1788864743.586280:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788864743.586288:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbba7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6889:x1875760546589824:12345-0@lo:700: 00000100:00100000:0.0:1788864743.586323:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbed880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6691:1875760546589952:0@lo:700: 00000100:00100000:0.0:1788864743.586349:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864743.586370:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcac9b3900 going to sleep for 11 seconds 00000100:00100000:1.0:1788864743.586519:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546589952 00000100:00100000:1.0:1788864743.586524:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546589952 00000100:00100000:1.0:1788864743.586560:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788864743.586566:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6691:x1875760546589952:12345-0@lo:700: 40000000:02000000:1.0:1788864743.636318:0:5842:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1788864743.644477:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6691:x1875760546589952:12345-0@lo:700: Request processed in 57903us (58118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864743.644490:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788864743.644583:0:6691:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdcacbed880 x1875760546589952/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788864759 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864743.644597:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbed880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6691:1875760546589952:0@lo:700: 40000000:02000000:0.0:1788864743.644612:0:6691:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:0.0:1788864743.710622:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbba7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6889:x1875760546589824:12345-0@lo:700: Request processed in 124328us (124484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864743.710636:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788864743.710859:0:6889:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdcbba7ed80 x1875760546589824/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788864759 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864743.710876:0:6889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6889:1875760546589824:0@lo:700: 00000001:00080000:3.0:1788864743.711252:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788864743.711264:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:2.0:1788864743.733560:0:6889:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1788864743.736952:0:6889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6889:1875760546590080:0@lo:5: 00000100:00100000:2.0:1788864743.737014:0:6889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864743.737263:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546590080 00000100:00100000:1.0:1788864743.737271:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546590080 00000100:00100000:1.0:1788864743.737328:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788864743.737338:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6889:x1875760546590080:12345-0@lo:5: 00000100:00100000:0.0:1788864743.743978:0:6889:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca2c7ca80 going to sleep for 11 seconds 00002000:00080000:1.0:1788864743.744271:0:6685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788864743.744289:0:6685:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1788864743.747525:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6889:x1875760546590080:12345-0@lo:5: Request processed in 10183us (10504us total) trans 4294967298 rc 0/0 00010000:00080000:0.0:1788864743.747622:0:6889:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdcbc7e0e00 x1875760546590080/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788864759 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864743.747636:0:6889:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788864743.747650:0:6889:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9fdcbc7e0e00 x1875760546590080/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788864759 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864743.747672:0:6889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6889:1875760546590080:0@lo:5: 00000004:00080000:0.0:1788864743.747684:0:6889:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000100:00100000:1.0:1788864743.747809:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788864744.004871:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864745.028804:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788864745.582244:0:7054:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788864746.057217:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864747.078525:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864748.101469:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864748.868832:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788864748.868857:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546590208:0@lo:13: 00000100:00100000:0.0:1788864748.868923:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864748.869006:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546590208 00000100:00100000:0.0:1788864748.869014:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546590208 00000100:00100000:0.0:1788864748.869068:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788864748.869077:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875760546590208:12345-0@lo:13: 00002000:00000024:0.0:1788864748.869107:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788864748.869144:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875760546590208:12345-0@lo:13: Request processed in 69us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864748.869151:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788864748.869285:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788864748.869314:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdcacbed880 x1875760546590208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864748.869341:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546590208:0@lo:13: 00000100:00100000:2.0:1788864748.869509:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546590336:0@lo:400: 00000100:00100000:2.0:1788864748.869694:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864748.869745:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788864748.869751:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546590464:0@lo:400: 00000100:00100000:2.0:1788864748.869773:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864748.869826:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546590464 00000100:00100000:2.0:1788864748.869830:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546590464 00000100:00100000:2.0:1788864748.869856:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788864748.869861:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546590464:12345-0@lo:400: 00000100:00100000:2.0:1788864748.869894:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546590464:12345-0@lo:400: Request processed in 32us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864748.869900:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788864748.870778:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788864748.870793:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875760546590592:0@lo:400: 00000100:00100000:1.0:1788864748.870833:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864748.870871:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546590336 00000100:00100000:1.0:1788864748.870875:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546590336 00000100:00100000:1.0:1788864748.870905:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788864748.870912:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:3300:x1875760546590336:12345-0@lo:400: 00000100:00100000:1.0:1788864748.870942:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:3300:x1875760546590336:12345-0@lo:400: Request processed in 31us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864748.870948:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788864748.871240:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546590592 00000100:00100000:1.0:1788864748.871244:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546590592 00000100:00100000:1.0:1788864748.871277:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788864748.871283:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbba7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875760546590592:12345-0@lo:400: 00000100:00100000:1.0:1788864748.871317:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbba7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875760546590592:12345-0@lo:400: Request processed in 34us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864748.871323:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788864748.871339:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788864748.871359:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdcbc7e1880 x1875760546590592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864748.871370:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875760546590592:0@lo:400: 00010000:00080000:0.0:1788864748.872301:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdcbc7e0a80 x1875760546590464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864748.872315:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546590464:0@lo:400: 00000100:00100000:0.0:1788864748.872326:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546590336:0@lo:400: 00000001:00080000:3.0:1788864748.970428:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788864749.125021:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864750.150042:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864751.181883:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864752.199005:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864753.221169:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864753.989167:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546591104:0@lo:400: 00000100:00100000:1.0:1788864753.989241:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864753.989293:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788864753.989299:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546590720:0@lo:400: 00000100:00100000:1.0:1788864753.989330:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864753.989384:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546590848:0@lo:400: 00000100:00100000:1.0:1788864753.989419:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864753.989442:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788864753.989449:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546590976:0@lo:400: 00000100:00100000:1.0:1788864753.989474:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864753.989507:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546591104 00000100:00100000:1.0:1788864753.989514:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546591104 00000100:00100000:2.0:1788864753.989552:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546590720 00000100:00100000:2.0:1788864753.989559:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546590720 00000100:00100000:2.0:1788864753.989598:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788864753.989606:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:3302:x1875760546590720:12345-0@lo:400: 00000100:00100000:1.0:1788864753.989645:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788864753.989655:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbba7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546591104:12345-0@lo:400: 00000100:00100000:2.0:1788864753.990137:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:3302:x1875760546590720:12345-0@lo:400: Request processed in 529us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864753.990154:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788864753.990180:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbba7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546591104:12345-0@lo:400: Request processed in 525us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864753.990189:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788864753.990211:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546590720:0@lo:400: 00000100:00100000:1.0:1788864753.990221:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546590848 00000100:00100000:1.0:1788864753.990284:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546590848 00010000:00080000:2.0:1788864753.990289:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdcbba7ca80 x1875760546591104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864753.990301:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788864753.990315:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546591104:0@lo:400: 00000100:00100000:1.0:1788864753.990316:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546590976 00000100:00100000:1.0:1788864753.990322:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546590976 00000100:00100000:1.0:1788864753.990433:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788864753.990444:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbba7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546590848:12345-0@lo:400: 00000100:00100000:2.0:1788864753.990450:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788864753.990461:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbba7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546590976:12345-0@lo:400: 00000100:00100000:1.0:1788864753.990493:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbba7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546590848:12345-0@lo:400: Request processed in 50us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864753.990502:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788864753.990512:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbba7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546590976:12345-0@lo:400: Request processed in 52us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864753.990519:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788864753.990530:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788864753.990535:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788864753.990647:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdcbba7c000 x1875760546590976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864753.990659:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546590976:0@lo:400: 00010000:00080000:1.0:1788864753.990947:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdcbba7d180 x1875760546590848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864753.990959:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546590848:0@lo:400: 00000100:00100000:2.0:1788864753.991512:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788864753.991521:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546591232:0@lo:13: 00000100:00100000:2.0:1788864753.991554:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864753.991587:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546591232 00000100:00100000:2.0:1788864753.991591:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546591232 00000100:00100000:2.0:1788864753.991618:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788864753.991625:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546591232:12345-0@lo:13: 00002000:00000024:2.0:1788864753.991662:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788864753.991723:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546591232:12345-0@lo:13: Request processed in 98us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864753.991729:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788864753.992301:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdcbc7e0e00 x1875760546591232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864769 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864753.992318:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546591232:0@lo:13: 00010000:00010000:0.0:1788864754.244918:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864755.273268:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788864755.354790:0:7619:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788864755.354794:0:7619:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788864755.354928:0:7619:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fdcbfd92000 00000020:01000004:1.0:1788864755.354942:0:7619:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788864755.354962:0:7619:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788864755.354975:0:7619:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9fdc9f64b380) 00000020:00000080:1.0:1788864755.354989:0:7619:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788864755.370285:0:7619:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788864755.370682:0:7619:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788864755.404848:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788864755.414318:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788864755.414353:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788864755.414410:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788864755.414442:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788864755.414781:0:7619:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788864755.414814:0:7619:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788864755.414823:0:7619:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf8c13e2d0e959093 00000020:01000004:3.0:1788864755.414832:0:7619:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788864755.414854:0:7619:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788864755.414857:0:7619:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788864755.414863:0:7619:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788864755.414882:0:7619:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788864755.414886:0:7619:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788864755.460145:0:7619:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788864755.460183:0:7619:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.113@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788864755.460187:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788864755.460193:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788864755.460194:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788864755.460195:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788864755.460196:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788864755.460198:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788864755.460199:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788864755.460201:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788864755.460202:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788864755.460204:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788864755.460205:0:7619:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788864755.460209:0:7619:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788864755.460211:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788864755.460212:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788864755.460213:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788864755.460214:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788864755.460215:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788864755.460216:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788864755.460217:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788864755.460218:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788864755.460218:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788864755.460219:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788864755.460220:0:7619:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788864755.460246:0:7619:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788864755.460264:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546591360:0@lo:253: 00000100:00100000:2.0:1788864755.460339:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864755.460395:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbc4ffe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788864755.460524:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546591360 00000100:00100000:0.0:1788864755.460534:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546591360 00000100:00100000:0.0:1788864755.460589:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788864755.460598:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:7619:x1875760546591360:12345-0@lo:253: 20000000:01000000:0.0:1788864755.460627:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788864755.460631:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788864755.460635:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788864755.460639:0:5830:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788864755.461631:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788864755.461933:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788864755.461946:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788864755.461998:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788864755.462006:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788864755.462038:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788864755.462093:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788864755.462471:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788864755.462490:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:0.0:1788864755.462492:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:0.0:1788864755.462528:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788864755.462537:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788864755.462586:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788864755.462594:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:0.0:1788864755.462626:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788864755.462636:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788864755.462668:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788864755.462762:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788864755.463625:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1788864755.463646:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:1.0:1788864755.463649:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:1.0:1788864755.463680:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1788864755.463687:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788864755.463762:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1788864755.463772:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:1.0:1788864755.463807:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1788864755.463816:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788864755.464004:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1788864755.464042:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1788864755.464061:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788864755.464064:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788864755.464067:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788864755.464079:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788864755.464082:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788864755.464116:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788864755.464119:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788864755.473626:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788864755.473736:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788864755.473798:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788864755.474231:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788864755.474278:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788864755.474343:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788864755.474357:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788864755.474360:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788864755.476854:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788864755.477251:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788864755.477298:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788864755.477369:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788864755.477388:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788864755.477390:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788864755.478992:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788864755.479076:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788864755.479132:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788864755.481422:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1788864755.481617:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1788864755.481657:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1788864755.481677:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788864755.481679:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788864755.486753:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1788864755.486861:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1788864755.486890:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1788864755.487218:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1788864755.487288:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1788864755.487349:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1788864755.487367:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788864755.487369:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788864755.487378:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788864755.487397:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fdc81497600/0xf8c13e2d0e95909a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.487414:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdc80030800/0xf8c13e2d0e958fdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e958fd6 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.487423:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdc81497c00/0xf8c13e2d0e959007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e959000 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.487430:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdc80030000/0xf8c13e2d0e959031 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95902a expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.487436:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdca4d15a00/0xf8c13e2d0e95904d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e959046 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.487442:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e959085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95907e expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.487449:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fdc81497600/0xf8c13e2d0e95909a lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.487496:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e959085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e95907e expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.487510:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e959085 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e95907e expref: 16 pid: 5830 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864755.487533:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875760546591488:0@lo:104: 00000100:00100000:3.0:1788864755.487596:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788864755.487636:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdca4d15a00/0xf8c13e2d0e95904d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e959046 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.487644:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fdca4d15a00/0xf8c13e2d0e95904d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e959046 expref: 16 pid: 5827 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864755.487653:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875760546591616:0@lo:104: 00010000:00010000:3.0:1788864755.487674:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdc80030000/0xf8c13e2d0e959031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e95902a expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.487682:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fdc80030000/0xf8c13e2d0e959031 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e95902a expref: 16 pid: 5827 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864755.487690:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875760546591744:0@lo:104: 00010000:00010000:3.0:1788864755.487746:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdc81497c00/0xf8c13e2d0e959007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e959000 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.487754:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fdc81497c00/0xf8c13e2d0e959007 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e959000 expref: 16 pid: 5830 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864755.487761:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875760546591872:0@lo:104: 00010000:00010000:3.0:1788864755.487797:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdc80030800/0xf8c13e2d0e958fdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e958fd6 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.487804:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fdc80030800/0xf8c13e2d0e958fdd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e958fd6 expref: 16 pid: 5830 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864755.487821:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875760546592000:0@lo:104: 00000100:00100000:3.0:1788864755.487843:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1459900 going to sleep for 11 seconds 00000100:00100000:0.0:1788864755.487979:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788864755.487998:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864755.488031:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864755.488039:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864755.488046:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864755.488057:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546591488 00000100:00100000:0.0:1788864755.488063:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546591488 00000100:00100000:0.0:1788864755.488095:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546591616 00000100:00100000:0.0:1788864755.488098:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546591616 00000100:00100000:0.0:1788864755.488120:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546591744 00000100:00100000:0.0:1788864755.488123:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546591744 00000100:00100000:0.0:1788864755.488133:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546591872 00000100:00100000:0.0:1788864755.488135:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546591872 00000100:00100000:0.0:1788864755.488143:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546592000 00000100:00100000:0.0:1788864755.488145:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546592000 00000100:00100000:0.0:1788864755.488162:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788864755.488171:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca2dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+7:5830:x1875760546591488:12345-0@lo:104: 00010000:00010000:0.0:1788864755.488183:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e95907e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e959085 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488236:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788864755.488241:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca2dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+7:5830:x1875760546591488:12345-0@lo:104: Request processed in 72us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864755.488247:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788864755.488283:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788864755.488289:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+6:5830:x1875760546591616:12345-0@lo:104: 00010000:00010000:0.0:1788864755.488296:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdc80030200/0xf8c13e2d0e959046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e95904d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488325:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788864755.488330:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+6:5830:x1875760546591616:12345-0@lo:104: Request processed in 42us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864755.488335:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788864755.488356:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788864755.488361:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+5:5830:x1875760546591744:12345-0@lo:104: 00010000:00010000:0.0:1788864755.488369:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95902a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e959031 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488399:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788864755.488403:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+5:5830:x1875760546591744:12345-0@lo:104: Request processed in 43us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864755.488408:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788864755.488419:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788864755.488425:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+4:5830:x1875760546591872:12345-0@lo:104: 00010000:00010000:0.0:1788864755.488432:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdc80031200/0xf8c13e2d0e959000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e959007 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488467:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788864755.488472:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+4:5830:x1875760546591872:12345-0@lo:104: Request processed in 47us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864755.488477:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788864755.488488:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788864755.488493:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+3:5830:x1875760546592000:12345-0@lo:104: 00010000:00010000:0.0:1788864755.488500:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e958fd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e958fdd expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488525:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788864755.488529:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+3:5830:x1875760546592000:12345-0@lo:104: Request processed in 36us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864755.488535:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788864755.488550:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788864755.488562:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e95907e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e959085 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488568:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdc80030c00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:0.0:1788864755.488572:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e95907e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e959085 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488581:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e95907e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e959085 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788864755.488587:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e95907e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e959085 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864755.488593:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788864755.488620:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e95907e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959085 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488626:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788864755.488643:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e95907e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959085 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488650:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e95907e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959085 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488662:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788864755.488665:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdc80030200/0xf8c13e2d0e959046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e95904d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488670:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdc80030200 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:0.0:1788864755.488673:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdc80030200/0xf8c13e2d0e959046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e95904d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488689:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdc80030200/0xf8c13e2d0e959046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e95904d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788864755.488696:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdc80030200/0xf8c13e2d0e959046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e95904d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864755.488730:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788864755.488745:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdc80030200/0xf8c13e2d0e959046 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95904d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488751:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788864755.488757:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdc80030200/0xf8c13e2d0e959046 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95904d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488763:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdc80030200/0xf8c13e2d0e959046 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95904d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488772:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788864755.488774:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95902a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e959031 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488779:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc2045e00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:0.0:1788864755.488781:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95902a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e959031 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488788:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95902a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e959031 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788864755.488793:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95902a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e959031 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864755.488803:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788864755.488817:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95902a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959031 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488822:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788864755.488835:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95902a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959031 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488841:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95902a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959031 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488849:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788864755.488852:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdc80031200/0xf8c13e2d0e959000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e959007 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488857:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdc80031200 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:0.0:1788864755.488861:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdc80031200/0xf8c13e2d0e959000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e959007 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488866:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdc80031200/0xf8c13e2d0e959000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e959007 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788864755.488871:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdc80031200/0xf8c13e2d0e959000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e959007 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864755.488875:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788864755.488886:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdc80031200/0xf8c13e2d0e959000 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959007 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488891:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788864755.488904:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdc80031200/0xf8c13e2d0e959000 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959007 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488910:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdc80031200/0xf8c13e2d0e959000 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959007 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488919:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864755.488922:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e958fd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e958fdd expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488928:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca4d15200 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:0.0:1788864755.488930:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e958fd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e958fdd expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488937:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e958fd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e958fdd expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788864755.488944:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e958fd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e958fdd expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864755.488950:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788864755.488972:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e958fd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e958fdd expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488978:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788864755.488982:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e958fd6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e958fdd expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.488988:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e958fd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e958fdd expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.489001:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864755.489008:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864755.489009:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864755.489016:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864755.489028:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546592128:0@lo:103: 00000100:00100000:0.0:1788864755.489059:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864755.489079:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546592640:0@lo:103: 00000100:00100000:0.0:1788864755.489097:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864755.489114:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788864755.489120:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546592256:0@lo:103: 00000100:00100000:0.0:1788864755.489139:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864755.489166:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546592384:0@lo:103: 00000100:00100000:0.0:1788864755.489186:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864755.489197:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788864755.489202:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546592512:0@lo:103: 00000100:00100000:0.0:1788864755.489218:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864755.489241:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546592128 00000100:00100000:0.0:1788864755.489245:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546592128 00010000:00010000:0.0:1788864755.489263:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e959085 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95907e expref: 17 pid: 5830 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864755.489279:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546592640 00000100:00100000:0.0:1788864755.489281:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546592640 00010000:00010000:0.0:1788864755.489291:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdc80030800/0xf8c13e2d0e958fdd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e958fd6 expref: 18 pid: 5830 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864755.489300:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546592256 00000100:00100000:0.0:1788864755.489302:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546592256 00010000:00010000:0.0:1788864755.489311:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdca4d15a00/0xf8c13e2d0e95904d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e959046 expref: 19 pid: 5827 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864755.489334:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546592384 00000100:00100000:0.0:1788864755.489337:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546592384 00010000:00010000:0.0:1788864755.489348:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdc80030000/0xf8c13e2d0e959031 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95902a expref: 20 pid: 5827 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864755.489356:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546592512 00000100:00100000:0.0:1788864755.489358:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546592512 00010000:00010000:0.0:1788864755.489366:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdc81497c00/0xf8c13e2d0e959007 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e959000 expref: 21 pid: 5830 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864755.489377:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788864755.489383:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+21:3300:x1875760546592128:12345-0@lo:103: 00010000:00010000:0.0:1788864755.489392:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864755.489396:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e959085 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95907e expref: 21 pid: 5830 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.489406:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e959085 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e95907e expref: 21 pid: 5830 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.489420:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864755.489448:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+21:3300:x1875760546592128:12345-0@lo:103: Request processed in 65us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864755.489454:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788864755.489469:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788864755.489474:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+20:3300:x1875760546592640:12345-0@lo:103: 00010000:00010000:0.0:1788864755.489482:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864755.489486:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdc80030800/0xf8c13e2d0e958fdd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e958fd6 expref: 20 pid: 5830 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.489504:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdc80030800/0xf8c13e2d0e958fdd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e958fd6 expref: 20 pid: 5830 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.489514:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864755.489539:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+20:3300:x1875760546592640:12345-0@lo:103: Request processed in 65us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864755.489544:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788864755.489556:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788864755.489562:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3300:x1875760546592256:12345-0@lo:103: 00010000:00010000:0.0:1788864755.489569:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864755.489572:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdca4d15a00/0xf8c13e2d0e95904d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e959046 expref: 19 pid: 5827 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.489581:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdca4d15a00/0xf8c13e2d0e95904d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e959046 expref: 19 pid: 5827 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.489589:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864755.489608:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3300:x1875760546592256:12345-0@lo:103: Request processed in 46us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864755.489614:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788864755.489624:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788864755.489630:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:3302:x1875760546592384:12345-0@lo:103: 00010000:00010000:0.0:1788864755.489637:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864755.489640:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdc80030000/0xf8c13e2d0e959031 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95902a expref: 18 pid: 5827 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.489649:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdc80030000/0xf8c13e2d0e959031 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e95902a expref: 18 pid: 5827 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.489665:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864755.489691:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:3302:x1875760546592384:12345-0@lo:103: Request processed in 60us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864755.489697:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788864755.489730:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788864755.489736:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:3302:x1875760546592512:12345-0@lo:103: 00010000:00010000:0.0:1788864755.489744:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864755.489749:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdc81497c00/0xf8c13e2d0e959007 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e959000 expref: 17 pid: 5830 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.489758:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdc81497c00/0xf8c13e2d0e959007 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e959000 expref: 17 pid: 5830 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.489769:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fdc81497600/0xf8c13e2d0e95909a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.489777:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdc81497600/0xf8c13e2d0e95909a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.489790:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fdc81497600/0xf8c13e2d0e95909a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.489797:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fdc81497600/0xf8c13e2d0e95909a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.489804:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fdc81497600/0xf8c13e2d0e95909a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.489810:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fdc81497600/0xf8c13e2d0e95909a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.489822:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdc81497600 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788864755.489826:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fdc81497600/0xf8c13e2d0e95909a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.489834:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fdc81497600/0xf8c13e2d0e95909a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.489841:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fdc81497600/0xf8c13e2d0e95909a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.489850:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864755.489872:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:3302:x1875760546592512:12345-0@lo:103: Request processed in 136us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864755.489877:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788864755.489929:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546592512:0@lo:103: 00000100:00100000:0.0:1788864755.489937:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546592384:0@lo:103: 00000100:00100000:0.0:1788864755.489971:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546592256:0@lo:103: 00000100:00100000:0.0:1788864755.489978:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546592128:0@lo:103: 00000100:00100000:0.0:1788864755.489984:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546592640:0@lo:103: 00010000:00010000:2.0:1788864755.490151:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e959085 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e95907e expref: 16 pid: 5830 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864755.490164:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875760546591488:0@lo:104: 00010000:00010000:2.0:1788864755.490174:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdca4d15a00/0xf8c13e2d0e95904d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e959046 expref: 15 pid: 5827 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864755.490182:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875760546591616:0@lo:104: 00010000:00010000:2.0:1788864755.490190:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdc80030000/0xf8c13e2d0e959031 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e95902a expref: 14 pid: 5827 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864755.490200:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875760546591744:0@lo:104: 00010000:00010000:2.0:1788864755.490209:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdc81497c00/0xf8c13e2d0e959007 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e959000 expref: 13 pid: 5830 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864755.490217:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875760546591872:0@lo:104: 00010000:00010000:2.0:1788864755.490225:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdc80030800/0xf8c13e2d0e958fdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e958fd6 expref: 12 pid: 5830 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864755.490232:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875760546592000:0@lo:104: 00010000:00010000:2.0:1788864755.490256:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fdc81497600/0xf8c13e2d0e95909a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864755.490264:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fdc81497600/0xf8c13e2d0e95909a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864755.490270:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fdc81497600/0xf8c13e2d0e95909a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864755.490283:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdc81497600/0xf8c13e2d0e95909a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788864755.490296:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788864755.565036:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:7619:x1875760546591360:12345-0@lo:253: Request processed in 104431us (104688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864755.565051:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788864755.568269:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546591360:0@lo:253: 10000000:01000000:2.0:1788864755.568288:0:7619:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788864755.568291:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788864755.568293:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788864755.568295:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788864755.568296:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788864755.568298:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788864755.568299:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788864755.568301:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788864755.568302:0:7619:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788864755.568303:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788864755.568305:0:7619:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788864755.568331:0:7619:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fdcbfd92000 from lustre-OST0001 10000000:01000000:2.0:1788864755.568360:0:7619:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788864755.568363:0:7619:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788864755.568372:0:7619:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fdca1ff4d40 local copy 10000000:01000000:2.0:1788864755.568376:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788864755.568411:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e9590a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864755.568423:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e9590a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864755.568434:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e9590a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864755.568452:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546592768:0@lo:101: 00000100:00100000:2.0:1788864755.568585:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864755.568826:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbc4ff480 going to sleep for 11 seconds 00000100:00100000:1.0:1788864755.571550:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546592768 00000100:00100000:1.0:1788864755.571564:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546592768 00000100:00100000:1.0:1788864755.571685:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788864755.571695:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+11:7619:x1875760546592768:12345-0@lo:101: 00010000:00010000:1.0:1788864755.572580:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864755.572601:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdca4d14400/0xf8c13e2d0e9590a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e9590a1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864755.572628:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdca4d14400/0xf8c13e2d0e9590a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e9590a1 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864755.572655:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdca4d14400/0xf8c13e2d0e9590a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e9590a1 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864755.572665:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca4d14400, rc 0) 00000100:00100000:1.0:1788864755.572771:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:7619:x1875760546592768:12345-0@lo:101: Request processed in 1077us (4185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864755.572778:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788864755.572875:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546592768:0@lo:101: 00010000:00010000:3.0:1788864755.572893:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e9590a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf8c13e2d0e9590a8 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.572902:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e9590a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf8c13e2d0e9590a8 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864755.573026:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546592896:0@lo:501: 00000100:00100000:3.0:1788864755.573062:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864755.574256:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca2c019c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864755.574340:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546592896 00000100:00100000:2.0:1788864755.574348:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546592896 00000100:00100000:0.0:1788864755.577527:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788864755.577544:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:7619:x1875760546592896:12345-0@lo:501: 00000100:00100000:0.0:1788864755.577839:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:7619:x1875760546592896:12345-0@lo:501: Request processed in 299us (4775us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788864755.577847:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788864755.578022:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546592896:0@lo:501: 10000000:01000000:3.0:1788864755.578045:0:7619:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788864755.578077:0:7619:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788864755.578086:0:7619:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e9590a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf8c13e2d0e9590a8 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.578098:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e9590a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf8c13e2d0e9590a8 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.578105:0:7619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e9590a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf8c13e2d0e9590a8 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.578127:0:7619:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788864755.578149:0:7619:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fdcbfd92000 10000000:01000000:3.0:1788864755.578159:0:7619:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788864755.578165:0:7619:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788864755.578167:0:7619:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788864755.578172:0:7619:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788864755.578174:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788864755.578202:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdc81497600/0xf8c13e2d0e9590af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.578209:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdc81497600/0xf8c13e2d0e9590af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.578217:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdc81497600/0xf8c13e2d0e9590af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864755.578234:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546593024:0@lo:101: 00000100:00100000:3.0:1788864755.578269:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864755.578297:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca2c01b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788864755.578312:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546593024 00000100:00100000:3.0:1788864755.578317:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546593024 00000100:00100000:3.0:1788864755.578335:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788864755.578341:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:7619:x1875760546593024:12345-0@lo:101: 00010000:00010000:3.0:1788864755.578349:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864755.578359:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdc81497c00/0xf8c13e2d0e9590b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e9590af expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.578379:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdc81497c00/0xf8c13e2d0e9590b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e9590af expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.578388:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdc81497c00/0xf8c13e2d0e9590b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e9590af expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.578405:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdc81497c00, rc 0) 00000100:00100000:3.0:1788864755.578434:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:7619:x1875760546593024:12345-0@lo:101: Request processed in 93us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864755.578440:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788864755.578482:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546593024:0@lo:101: 00010000:00010000:3.0:1788864755.578493:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdc81497600/0xf8c13e2d0e9590af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9590b6 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.578501:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdc81497600/0xf8c13e2d0e9590af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e9590b6 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864755.578551:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546593152:0@lo:501: 00000100:00100000:3.0:1788864755.578574:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864755.578586:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca2c01b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788864755.578597:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546593152 00000100:00100000:3.0:1788864755.578600:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546593152 00000100:00100000:3.0:1788864755.578614:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788864755.578619:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:7619:x1875760546593152:12345-0@lo:501: 00000100:00100000:3.0:1788864755.578793:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:7619:x1875760546593152:12345-0@lo:501: Request processed in 173us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864755.578800:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788864755.578826:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546593152:0@lo:501: 00000100:00100000:3.0:1788864755.578846:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546593280:0@lo:503: 00000100:00100000:3.0:1788864755.578877:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864755.578889:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca2c01b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788864755.578909:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546593280 00000100:00100000:3.0:1788864755.578912:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546593280 00000100:00100000:3.0:1788864755.578928:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788864755.578934:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:7619:x1875760546593280:12345-0@lo:503: 00000100:00100000:3.0:1788864755.579244:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:7619:x1875760546593280:12345-0@lo:503: Request processed in 308us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864755.579250:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788864755.579288:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546593280:0@lo:503: 00000040:00080000:3.0:1788864755.579572:0:7619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788864755.579636:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546593408:0@lo:502: 00000100:00100000:3.0:1788864755.579671:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864755.579686:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca2c01b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788864755.579722:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546593408 00000100:00100000:3.0:1788864755.579726:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546593408 00000100:00100000:3.0:1788864755.579745:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788864755.579751:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:7619:x1875760546593408:12345-0@lo:502: 00000100:00100000:3.0:1788864755.579868:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:7619:x1875760546593408:12345-0@lo:502: Request processed in 116us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864755.579874:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788864755.579907:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546593408:0@lo:502: 00000040:00080000:3.0:1788864755.580130:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788864755.580176:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788864755.580209:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788864755.580251:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788864755.580285:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788864755.580318:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788864755.580338:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546593536:0@lo:502: 00000100:00100000:3.0:1788864755.580373:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864755.580387:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca0f95000 going to sleep for 11 seconds 00000100:00100000:3.0:1788864755.580399:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546593536 00000100:00100000:3.0:1788864755.580402:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546593536 00000100:00100000:3.0:1788864755.580418:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788864755.580423:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:7619:x1875760546593536:12345-0@lo:502: 00010000:00010000:0.0:1788864755.580692:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864755.580720:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e9590a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf8c13e2d0e9590a8 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.580730:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc2044600 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:0.0:1788864755.580733:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e9590a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf8c13e2d0e9590a8 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.580742:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e9590a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xf8c13e2d0e9590a8 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788864755.580747:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e9590a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf8c13e2d0e9590a8 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864755.580752:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788864755.580773:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e9590a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf8c13e2d0e9590a8 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.580778:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788864755.580793:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e9590a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf8c13e2d0e9590a8 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.580799:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e9590a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf8c13e2d0e9590a8 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.580811:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864755.580812:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864755.580814:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864755.580823:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546593664:0@lo:103: 00000100:00100000:0.0:1788864755.580852:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864755.580889:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546593664 00000100:00100000:0.0:1788864755.580898:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546593664 00000100:00100000:0.0:1788864755.580929:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788864755.580935:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:3301:x1875760546593664:12345-0@lo:103: 00010000:00010000:0.0:1788864755.580943:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864755.580962:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdca4d14400/0xf8c13e2d0e9590a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf8c13e2d0e9590a1 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.580973:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864755.580999:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:3301:x1875760546593664:12345-0@lo:103: Request processed in 64us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864755.581004:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788864755.581034:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546593664:0@lo:103: 00000100:00100000:3.0:1788864755.581240:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:7619:x1875760546593536:12345-0@lo:502: Request processed in 816us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864755.581247:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788864755.582646:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546593536:0@lo:502: 00000040:00080000:0.0:1788864755.582824:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788864755.582838:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1788864755.584967:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788864755.584977:0:7626:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788864755.584984:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864755.584986:0:7626:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788864755.584992:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788864755.585006:0:7626:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9fdca14c8000) 00000020:00000080:0.0:1788864755.585033:0:7626:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788864755.585039:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788864755.585095:0:7626:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fdcbfd92000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788864755.585103:0:7626:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788864755.585109:0:7626:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf8c13e2d0e9590c4 00010000:00010000:0.0:1788864755.592737:0:7626:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1788864755.593031:0:7626:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788864755.597397:0:7626:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788864755.598610:0:7626:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788864755.606816:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788864755.607383:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788864755.618526:0:7626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788864755.618538:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788864755.618544:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864755.618546:0:7626:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788864755.618549:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788864755.618552:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864755.618554:0:7626:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788864755.618557:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788864755.618559:0:7626:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788864755.618614:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788864755.618618:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864755.618619:0:7626:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788864755.618623:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788864755.618841:0:7619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788864755.618868:0:7619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788864755.618894:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdc81497600/0xf8c13e2d0e9590af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9590b6 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.618905:0:7619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdc81497600/0xf8c13e2d0e9590af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9590b6 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864755.618913:0:7619:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fdcbfd92000 from 1 10000000:01000000:3.0:1788864755.618915:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788864755.618969:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdc81496600/0xf8c13e2d0e9590cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.618978:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdc81496600/0xf8c13e2d0e9590cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.618988:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdc81496600/0xf8c13e2d0e9590cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864755.619008:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546593792:0@lo:101: 00000100:00100000:3.0:1788864755.619077:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864755.619111:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca2c01b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788864755.619131:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546593792 00000100:00100000:3.0:1788864755.619137:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546593792 00000100:00100000:3.0:1788864755.619181:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788864755.619189:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:7619:x1875760546593792:12345-0@lo:101: 00010000:00010000:3.0:1788864755.619200:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864755.619210:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdc81496800/0xf8c13e2d0e9590d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e9590cb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.619231:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdc81496800/0xf8c13e2d0e9590d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e9590cb expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.619240:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdc81496800/0xf8c13e2d0e9590d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e9590cb expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.619246:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdc81496800, rc 0) 00000100:00100000:3.0:1788864755.619280:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:7619:x1875760546593792:12345-0@lo:101: Request processed in 92us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864755.619286:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788864755.619325:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546593792:0@lo:101: 00010000:00010000:3.0:1788864755.619338:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdc81496600/0xf8c13e2d0e9590cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9590d2 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.619345:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdc81496600/0xf8c13e2d0e9590cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e9590d2 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864755.619417:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546593920:0@lo:501: 00000100:00100000:3.0:1788864755.619450:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864755.619580:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca2c01b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788864755.619593:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546593920 00000100:00100000:3.0:1788864755.619596:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546593920 00000100:00100000:3.0:1788864755.619614:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788864755.619620:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:7619:x1875760546593920:12345-0@lo:501: 00000100:00100000:3.0:1788864755.619827:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:7619:x1875760546593920:12345-0@lo:501: Request processed in 206us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864755.619833:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788864755.619859:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546593920:0@lo:501: 00000100:00100000:3.0:1788864755.619880:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546594048:0@lo:503: 00000100:00100000:3.0:1788864755.619912:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864755.619925:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca0f95600 going to sleep for 11 seconds 00000100:00100000:3.0:1788864755.619936:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546594048 00000100:00100000:3.0:1788864755.619940:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546594048 00000100:00100000:3.0:1788864755.619966:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788864755.619973:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:7619:x1875760546594048:12345-0@lo:503: 00000100:00100000:3.0:1788864755.620349:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:7619:x1875760546594048:12345-0@lo:503: Request processed in 376us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864755.620355:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788864755.620425:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546594048:0@lo:503: 00000040:00080000:1.0:1788864755.620676:0:7619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788864755.620766:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546594176:0@lo:502: 00000100:00100000:1.0:1788864755.620798:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864755.620824:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfde3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788864755.621070:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546594176 00000100:00100000:3.0:1788864755.621075:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546594176 00000100:00100000:3.0:1788864755.621108:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788864755.621115:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:7619:x1875760546594176:12345-0@lo:502: 00000100:00100000:3.0:1788864755.621259:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:7619:x1875760546594176:12345-0@lo:502: Request processed in 144us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864755.621274:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788864755.621358:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546594176:0@lo:502: 00000040:00080000:1.0:1788864755.621610:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788864755.621657:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788864755.621681:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546594304:0@lo:502: 00000100:00100000:1.0:1788864755.621739:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864755.621770:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfde3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788864755.621881:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546594304 00000100:00100000:3.0:1788864755.621886:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546594304 00000100:00100000:3.0:1788864755.621916:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788864755.621923:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:7619:x1875760546594304:12345-0@lo:502: 00000100:00100000:3.0:1788864755.622049:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:7619:x1875760546594304:12345-0@lo:502: Request processed in 126us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864755.622056:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788864755.622094:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546594304:0@lo:502: 00000040:00080000:3.0:1788864755.622171:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788864755.622181:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788864755.622674:0:7629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788864755.622683:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864755.622685:0:7629:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788864755.622691:0:7629:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fdcbfd92000 00000020:00000080:1.0:1788864755.622694:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788864755.622741:0:7629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788864755.622745:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864755.622746:0:7629:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788864755.622749:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788864755.622863:0:7619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788864755.622879:0:7619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788864755.622895:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdc81496600/0xf8c13e2d0e9590cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9590d2 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.622907:0:7619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdc81496600/0xf8c13e2d0e9590cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9590d2 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864755.622948:0:7619:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788864755.622960:0:7619:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fdcbfd92000 10000000:01000000:3.0:1788864755.622963:0:7619:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fdcbfd92000 10000000:01000000:3.0:1788864755.622967:0:7619:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788864755.622972:0:7619:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fdcbfd92000 from 1 10000000:01000000:3.0:1788864755.622975:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788864755.623010:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ec00/0xf8c13e2d0e9590d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.623025:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ec00/0xf8c13e2d0e9590d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864755.623034:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ec00/0xf8c13e2d0e9590d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864755.623048:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546594432:0@lo:101: 00000100:00100000:3.0:1788864755.623083:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864755.623104:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1fd03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864755.623208:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546594432 00000100:00100000:1.0:1788864755.623214:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546594432 00000100:00100000:1.0:1788864755.623238:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788864755.623244:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:7619:x1875760546594432:12345-0@lo:101: 00010000:00010000:1.0:1788864755.623252:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864755.623263:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdca4d14c00/0xf8c13e2d0e9590e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e9590d9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864755.623282:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdca4d14c00/0xf8c13e2d0e9590e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e9590d9 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864755.623292:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdca4d14c00/0xf8c13e2d0e9590e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e9590d9 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864755.623300:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca4d14c00, rc 0) 00000100:00100000:1.0:1788864755.623340:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:7619:x1875760546594432:12345-0@lo:101: Request processed in 95us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864755.623346:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788864755.623406:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546594432:0@lo:101: 00010000:00010000:0.0:1788864755.623418:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ec00/0xf8c13e2d0e9590d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9590e0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.623427:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ec00/0xf8c13e2d0e9590d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e9590e0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864755.623500:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546594560:0@lo:501: 00000100:00100000:0.0:1788864755.623524:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864755.623547:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfdfb600 going to sleep for 11 seconds 00000100:00100000:1.0:1788864755.623638:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546594560 00000100:00100000:1.0:1788864755.623642:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546594560 00000100:00100000:1.0:1788864755.623670:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788864755.623677:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:7619:x1875760546594560:12345-0@lo:501: 00000100:00100000:1.0:1788864755.623895:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:7619:x1875760546594560:12345-0@lo:501: Request processed in 218us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864755.623901:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788864755.624029:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546594560:0@lo:501: 00000100:00100000:0.0:1788864755.624056:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546594688:0@lo:503: 00000100:00100000:0.0:1788864755.624093:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864755.624126:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfdfb600 going to sleep for 11 seconds 00000100:00100000:1.0:1788864755.624196:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546594688 00000100:00100000:1.0:1788864755.624201:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546594688 00000100:00100000:1.0:1788864755.624230:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788864755.624236:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:7619:x1875760546594688:12345-0@lo:503: 00000100:00100000:1.0:1788864755.624381:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:7619:x1875760546594688:12345-0@lo:503: Request processed in 145us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864755.624388:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788864755.627674:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546594688:0@lo:503: 00000040:00080000:0.0:1788864755.627994:0:7619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788864755.628071:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546594816:0@lo:502: 00000100:00100000:0.0:1788864755.628137:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864755.628178:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfdfb600 going to sleep for 11 seconds 00000100:00100000:3.0:1788864755.629399:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546594816 00000100:00100000:3.0:1788864755.629409:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546594816 00000100:00100000:3.0:1788864755.629519:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788864755.629532:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:7619:x1875760546594816:12345-0@lo:502: 00000100:00100000:3.0:1788864755.629888:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:7619:x1875760546594816:12345-0@lo:502: Request processed in 358us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864755.629896:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788864755.637605:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546594816:0@lo:502: 00000040:00080000:3.0:1788864755.638144:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788864755.638207:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788864755.638241:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788864755.638288:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788864755.638323:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788864755.638372:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788864755.638408:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788864755.639464:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788864755.639565:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788864755.639604:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788864755.639641:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788864755.639693:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788864755.639765:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788864755.639803:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788864755.639853:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788864755.639891:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788864755.639925:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788864755.641091:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788864755.641138:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788864755.641173:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788864755.641221:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788864755.641259:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788864755.641294:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788864755.641362:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788864755.641399:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788864755.641432:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788864755.641491:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788864755.641527:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788864755.641561:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788864755.641630:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788864755.641674:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788864755.641845:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788864755.641882:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788864755.641929:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788864755.641978:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788864755.642028:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788864755.642065:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788864755.642111:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546594944:0@lo:502: 00000100:00100000:3.0:1788864755.642189:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864755.642312:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1fd03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864755.642430:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546594944 00000100:00100000:0.0:1788864755.642438:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546594944 00000100:00100000:0.0:1788864755.642570:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788864755.642580:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:7619:x1875760546594944:12345-0@lo:502: 00000100:00100000:0.0:1788864755.643000:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:7619:x1875760546594944:12345-0@lo:502: Request processed in 421us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864755.643008:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788864755.643084:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546594944:0@lo:502: 00000040:00080000:3.0:1788864755.643158:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788864755.643168:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788864755.643770:0:7631:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788864755.643784:0:7631:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9fdc9099b380) 00000020:00000080:3.0:1788864755.643804:0:7631:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1788864755.643865:0:7631:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fdcbfd92000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788864755.643868:0:7631:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fdcbfd92000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788864755.643871:0:7631:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fdcbfd92000 3 00010000:00080000:3.0:1788864755.643897:0:7631:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fdb81802000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.113@tcp at head 00010000:00010000:3.0:1788864755.647113:0:7631:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1788864755.647393:0:7631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788864755.647427:0:7631:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788864755.647440:0:7631:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf8c13e2d0e9590ee 00000100:00080000:3.0:1788864755.647449:0:7631:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788864755.647468:0:7631:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fdb81802000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788864755.647498:0:7631:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fdca003f480 x1875760546595072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788864755.647528:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875760546595072:0@lo:38: 00000100:00100000:3.0:1788864755.647583:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864755.647633:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546595072 00000100:00100000:3.0:1788864755.647639:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546595072 00000100:00100000:3.0:1788864755.647663:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788864755.647669:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3299:x1875760546595072:12345-0@lo:38: 00010000:00080000:3.0:1788864755.647689:0:5836:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:3.0:1788864755.647749:0:5836:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf8c13e2d0e9590f5 00000004:00100000:3.0:1788864755.647762:0:5836:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788864755.647787:0:5836:0:(import.c:65:import_set_state_nolock()) ffff9fdb824a9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788864755.647826:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875760546595072:12345-0@lo:38: Request processed in 156us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864755.647832:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788864755.647870:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdca003f480 x1875760546595072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788864765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864755.647879:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788864755.647886:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788864755.647891:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788864755.647894:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788864755.647896:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fdb81802000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788864755.647902:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875760546595072:0@lo:38: 00000100:00080000:3.0:1788864755.647916:0:7631:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788864755.647993:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546595200:0@lo:400: 00000100:00100000:3.0:1788864755.648017:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864755.648035:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788864755.648039:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546595328:0@lo:400: 00000100:00100000:3.0:1788864755.648056:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864755.648076:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546595456:0@lo:400: 00000100:00100000:3.0:1788864755.648096:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864755.648122:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546595200 00000100:00100000:3.0:1788864755.648124:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546595200 00000100:00100000:3.0:1788864755.648146:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546595328 00000100:00100000:3.0:1788864755.648148:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546595328 00000100:00100000:3.0:1788864755.648170:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788864755.648176:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546595200:12345-0@lo:400: 00000100:00100000:3.0:1788864755.648208:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546595200:12345-0@lo:400: Request processed in 32us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864755.648214:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788864755.648225:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788864755.648232:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546595328:12345-0@lo:400: 00000100:00100000:3.0:1788864755.648264:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546595328:12345-0@lo:400: Request processed in 34us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864755.648270:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788864755.648296:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546595456 00000100:00100000:3.0:1788864755.648300:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546595456 00000100:00100000:3.0:1788864755.648323:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788864755.648329:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546595456:12345-0@lo:400: 00000100:00100000:3.0:1788864755.648371:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546595456:12345-0@lo:400: Request processed in 42us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864755.648377:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788864755.648392:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788864755.648396:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788864755.648415:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdca003dc00 x1875760546595456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864755.648424:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546595456:0@lo:400: 00010000:00080000:3.0:1788864755.648443:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdca003d180 x1875760546595328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864755.648451:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546595328:0@lo:400: 00010000:00080000:3.0:1788864755.648460:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdca003f480 x1875760546595200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864755.648466:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546595200:0@lo:400: 00000040:00080000:3.0:1788864755.651383:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1788864755.651570:0:7619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788864755.651595:0:7619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788864755.651615:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ec00/0xf8c13e2d0e9590d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9590e0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864755.651627:0:7619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ec00/0xf8c13e2d0e9590d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9590e0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788864755.651667:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788864755.651669:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788864755.651670:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788864755.651671:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788864755.651673:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788864755.651674:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788864755.651675:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788864755.651677:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788864755.651678:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788864755.651679:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788864755.651681:0:7619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788864755.651684:0:7619:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788864755.651686:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788864755.651688:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788864755.651689:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788864755.651690:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788864755.651691:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788864755.651692:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788864755.651693:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788864755.651694:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788864755.651695:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788864755.651696:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788864755.651700:0:7619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788864755.651741:0:7619:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788864755.651755:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546595584:0@lo:253: 00000100:00100000:2.0:1788864755.651807:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864755.651834:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbc4ff240 going to sleep for 11 seconds 00000100:00100000:0.0:1788864755.652231:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbed500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7632:1875760546595712:0@lo:901: 00000100:00100000:0.0:1788864755.652263:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864755.652284:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfdfb780 going to sleep for 11 seconds 00000100:00100000:3.0:1788864755.652340:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546595584 00000100:00100000:3.0:1788864755.652346:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546595584 00000100:00100000:3.0:1788864755.652384:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788864755.652391:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:7619:x1875760546595584:12345-0@lo:253: 20000000:01000000:3.0:1788864755.652423:0:5827:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788864755.652436:0:5827:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788864755.653082:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546595712 00000100:00100000:2.0:1788864755.653087:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546595712 00000100:00100000:2.0:1788864755.653129:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788864755.653134:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7632:x1875760546595712:12345-0@lo:901: 00000100:00100000:2.0:1788864755.653401:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7632:x1875760546595712:12345-0@lo:901: Request processed in 265us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864755.653408:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788864755.653555:0:7632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdcacbed500 x1875760546595712/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788864771 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864755.653568:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbed500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7632:1875760546595712:0@lo:901: 00000100:00080000:0.0:1788864755.653671:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:3.0:1788864755.675605:0:5827:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788864755.675626:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788864755.675656:0:5851:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788864755.675661:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788864755.675682:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fdcc2045000/0xf8c13e2d0e9590fc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864755.675700:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdca4d14800/0xf8c13e2d0e95903f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e959038 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864755.675723:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fdcc2045000/0xf8c13e2d0e9590fc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864755.675763:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdca4d14800/0xf8c13e2d0e95903f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e959038 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864755.675777:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fdca4d14800/0xf8c13e2d0e95903f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e959038 expref: 14 pid: 5827 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864755.675801:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1875760546595840:0@lo:104: 00000100:00100000:2.0:1788864755.675855:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864755.675892:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546595840 00000100:00100000:2.0:1788864755.675893:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbc4ff780 going to sleep for 11 seconds 00000100:00100000:1.0:1788864755.675901:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546595840 00000100:00100000:1.0:1788864755.675962:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788864755.675971:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+3:5851:x1875760546595840:12345-0@lo:104: 00010000:00010000:1.0:1788864755.676024:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959038 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e95903f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864755.676083:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788864755.676089:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+3:5851:x1875760546595840:12345-0@lo:104: Request processed in 120us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864755.676096:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788864755.676104:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1875760546595840:0@lo:104: 00010000:00010000:1.0:1788864755.676114:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788864755.676120:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959038 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e95903f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864755.676121:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fdcc2045000/0xf8c13e2d0e9590fc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864755.676127:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdc80030400 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:1.0:1788864755.676131:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959038 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e95903f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864755.676139:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e95903f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788864755.676151:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e95903f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788864755.676156:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788864755.676194:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959038 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95903f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864755.676264:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788864755.676281:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959038 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95903f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864755.676287:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959038 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95903f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864755.676302:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864755.676304:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864755.676306:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864755.676315:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546595968:0@lo:103: 00000100:00100000:1.0:1788864755.676349:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864755.676482:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546595968 00000100:00100000:0.0:1788864755.676487:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546595968 00010000:00010000:0.0:1788864755.676505:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdca4d14800/0xf8c13e2d0e95903f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e959038 expref: 15 pid: 5827 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864755.676528:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788864755.676535:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1e51450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:3301:x1875760546595968:12345-0@lo:103: 00010000:00010000:0.0:1788864755.676544:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864755.676549:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdca4d14800/0xf8c13e2d0e95903f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e959038 expref: 15 pid: 5827 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.676569:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdca4d14800/0xf8c13e2d0e95903f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e959038 expref: 15 pid: 5827 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.676581:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdca4d14800/0xf8c13e2d0e95903f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e959038 expref: 15 pid: 5827 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.676597:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fdcc2045000/0xf8c13e2d0e9590fc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.676605:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcc2045000/0xf8c13e2d0e9590fc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788864755.676617:0:5820:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003564278s 00010000:00010000:0.0:1788864755.676622:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fdcc2045000/0xf8c13e2d0e9590fc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.676629:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fdcc2045000/0xf8c13e2d0e9590fc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.676636:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fdcc2045000/0xf8c13e2d0e9590fc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.676642:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fdcc2045000/0xf8c13e2d0e9590fc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.676647:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc2045000 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788864755.676650:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fdcc2045000/0xf8c13e2d0e9590fc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.676657:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fdcc2045000/0xf8c13e2d0e9590fc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.676684:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fdcc2045000/0xf8c13e2d0e9590fc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864755.676693:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864755.676741:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1e51450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:3301:x1875760546595968:12345-0@lo:103: Request processed in 206us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864755.676747:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788864755.676768:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546595968:0@lo:103: 00010000:00010000:1.0:1788864755.677034:0:5851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fdcc2045000/0xf8c13e2d0e9590fc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864755.677042:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fdcc2045000/0xf8c13e2d0e9590fc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864755.677048:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcc2045000/0xf8c13e2d0e9590fc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864755.683305:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:7619:x1875760546595584:12345-0@lo:253: Request processed in 30905us (31489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864755.683318:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788864755.683419:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:7619:1875760546595584:0@lo:253: 10000000:01000000:3.0:1788864755.683434:0:7619:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788864755.683438:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788864755.683440:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788864755.683441:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788864755.683442:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788864755.683444:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788864755.683445:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788864755.683447:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788864755.683448:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788864755.683450:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788864755.683451:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788864755.683453:0:7619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788864755.683477:0:7619:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788864755.687980:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788864755.688231:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788864755.688582:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788864755.688698:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788864755.688935:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788864755.689237:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788864755.690081:0:7619:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788864755.922186:0:7619:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788864755.922194:0:7619:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788864755.922226:0:7619:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788864755.922286:0:7619:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788864755.922299:0:7619:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788864755.922326:0:7619:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788864756.293041:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864757.316797:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864758.340808:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864759.108912:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788864759.108951:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546596096:0@lo:13: 00000100:00100000:0.0:1788864759.109045:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864759.109124:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546596096 00000100:00100000:0.0:1788864759.109132:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546596096 00000100:00100000:0.0:1788864759.109196:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788864759.109206:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546596096:12345-0@lo:13: 00002000:00000024:0.0:1788864759.109252:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788864759.109298:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546596096:12345-0@lo:13: Request processed in 93us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864759.109305:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788864759.109328:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788864759.109360:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcacbef480 x1875760546596096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864759.109379:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546596096:0@lo:13: 00010000:00010000:1.0:1788864759.365589:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864760.390056:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864760.648340:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546596352:0@lo:400: 00000100:00100000:0.0:1788864760.648508:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546596224:0@lo:400: 00000100:00100000:0.0:1788864760.648572:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864760.648634:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875760546596736:0@lo:400: 00000100:00100000:0.0:1788864760.648670:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546596224 00000100:00100000:0.0:1788864760.648680:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546596224 00000100:00100000:0.0:1788864760.648759:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788864760.648782:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:3303:x1875760546596224:12345-0@lo:400: 00000100:00100000:0.0:1788864760.648841:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:3303:x1875760546596224:12345-0@lo:400: Request processed in 72us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864760.648849:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788864760.648924:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875760546596480:0@lo:400: 00000100:00100000:1.0:1788864760.649229:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864760.649295:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864760.649321:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546596352 00000100:00100000:1.0:1788864760.649325:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546596352 00000100:00100000:1.0:1788864760.649364:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546596480 00000100:00100000:1.0:1788864760.649367:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546596480 00000100:00100000:1.0:1788864760.649394:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788864760.649399:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbba7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546596352:12345-0@lo:400: 00000100:00100000:1.0:1788864760.649597:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbba7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546596352:12345-0@lo:400: Request processed in 197us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864760.649604:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788864760.649618:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788864760.649624:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbba7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875760546596480:12345-0@lo:400: 00000100:00100000:1.0:1788864760.649652:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbba7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875760546596480:12345-0@lo:400: Request processed in 28us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864760.649657:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788864760.649677:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788864760.649735:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcbba7e680 x1875760546596480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864760.649752:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875760546596480:0@lo:400: 00000100:00100000:1.0:1788864760.649845:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864760.649875:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546596224:0@lo:400: 00000100:00100000:1.0:1788864760.649884:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788864760.649892:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546596608:0@lo:400: 00000100:00100000:1.0:1788864760.650075:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864760.650164:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546596736 00000100:00100000:0.0:1788864760.650169:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546596736 00000100:00100000:0.0:1788864760.650205:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788864760.650212:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbba7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875760546596736:12345-0@lo:400: 00000100:00100000:0.0:1788864760.650261:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbba7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875760546596736:12345-0@lo:400: Request processed in 49us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864760.650267:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788864760.650312:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcbba7f480 x1875760546596352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864760.650323:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546596352:0@lo:400: 00000100:00080000:0.0:1788864760.650343:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788864760.650410:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcbba7c000 x1875760546596736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864760.650419:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875760546596736:0@lo:400: 00000100:00100000:2.0:1788864760.653804:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546596608 00000100:00100000:2.0:1788864760.653896:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546596608 00000100:00100000:2.0:1788864760.653993:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788864760.654006:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbba7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546596608:12345-0@lo:400: 00000100:00100000:2.0:1788864760.654127:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbba7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546596608:12345-0@lo:400: Request processed in 124us (4051us total) trans 0 rc 0/0 00010000:00080000:0.0:1788864760.654217:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcbba7c700 x1875760546596608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864760.654235:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546596608:0@lo:400: 00000100:00100000:2.0:1788864760.655212:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788864761.413005:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788864762.301265:0:7976:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788864762.441150:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864763.474777:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864764.228954:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546596864:0@lo:13: 00000100:00100000:1.0:1788864764.229032:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864764.229164:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546596864 00000100:00100000:0.0:1788864764.229186:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546596864 00000100:00100000:0.0:1788864764.229259:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788864764.229268:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbba7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546596864:12345-0@lo:13: 00002000:00000024:0.0:1788864764.229312:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788864764.229356:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbba7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546596864:12345-0@lo:13: Request processed in 88us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864764.229362:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788864764.229539:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcacbef480 x1875760546596864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864764.229558:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546596864:0@lo:13: 00000100:00080000:3.0:1788864764.229961:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788864764.485112:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788864765.255013:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788864765.255021:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fdcacbf0000 from 30 10000000:01000000:3.0:1788864765.255035:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788864765.255078:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e600/0xf8c13e2d0e959103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864765.255090:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e600/0xf8c13e2d0e959103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864765.255100:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e600/0xf8c13e2d0e959103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864765.255123:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546596992:0@lo:101: 00000100:00100000:3.0:1788864765.255188:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864765.255251:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca8d28f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788864765.255296:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546596992 00000100:00100000:0.0:1788864765.255305:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546596992 00000100:00100000:0.0:1788864765.255359:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788864765.255368:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:5832:x1875760546596992:12345-0@lo:101: 00010000:00010000:0.0:1788864765.255380:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864765.255391:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdc80030000/0xf8c13e2d0e95910a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e959103 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864765.255415:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdc80030000/0xf8c13e2d0e95910a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e959103 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864765.255425:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdc80030000/0xf8c13e2d0e95910a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e959103 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864765.255433:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdc80030000, rc 0) 00000100:00100000:0.0:1788864765.255477:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:5832:x1875760546596992:12345-0@lo:101: Request processed in 110us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864765.255484:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788864765.255628:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546596992:0@lo:101: 00010000:00010000:3.0:1788864765.255643:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e600/0xf8c13e2d0e959103 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95910a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864765.255652:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e600/0xf8c13e2d0e959103 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95910a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864765.255700:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546597120:0@lo:501: 00000100:00100000:3.0:1788864765.255762:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864765.255785:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca8d28f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788864765.255972:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546597120 00000100:00100000:0.0:1788864765.255977:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546597120 00000100:00100000:0.0:1788864765.256005:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788864765.256011:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:5832:x1875760546597120:12345-0@lo:501: 00000100:00100000:0.0:1788864765.256362:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:5832:x1875760546597120:12345-0@lo:501: Request processed in 350us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864765.256370:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788864765.256401:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546597120:0@lo:501: 00000100:00100000:1.0:1788864765.256438:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546597248:0@lo:503: 00000100:00100000:1.0:1788864765.261257:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864765.261302:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbc4fff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788864765.261637:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546597248 00000100:00100000:0.0:1788864765.261646:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546597248 00000100:00100000:0.0:1788864765.261729:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788864765.261739:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:5832:x1875760546597248:12345-0@lo:503: 00000100:00100000:0.0:1788864765.262530:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:5832:x1875760546597248:12345-0@lo:503: Request processed in 792us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864765.262541:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788864765.263291:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546597248:0@lo:503: 00000100:00100000:2.0:1788864765.264302:0:8086:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8086:1875760546597376:0@lo:502: 00000100:00100000:2.0:1788864765.264362:0:8086:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864765.264403:0:8086:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc860b5900 going to sleep for 11 seconds 00000100:00100000:0.0:1788864765.264639:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546597376 00000100:00100000:0.0:1788864765.264646:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546597376 00000100:00100000:0.0:1788864765.264687:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788864765.264696:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:8086:x1875760546597376:12345-0@lo:502: 00000100:00100000:0.0:1788864765.266113:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:8086:x1875760546597376:12345-0@lo:502: Request processed in 1412us (1745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864765.266125:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788864765.266414:0:8086:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8086:1875760546597376:0@lo:502: 00000100:00100000:2.0:1788864765.266473:0:8086:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8086:1875760546597504:0@lo:502: 00000100:00100000:2.0:1788864765.266513:0:8086:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864765.266774:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546597504 00000100:00100000:3.0:1788864765.266781:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546597504 00000100:00100000:3.0:1788864765.266817:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788864765.266826:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:8086:x1875760546597504:12345-0@lo:502: 00000100:00100000:3.0:1788864765.267040:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:8086:x1875760546597504:12345-0@lo:502: Request processed in 215us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864765.267057:0:8086:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc860b5900 going to sleep for 11 seconds 00000100:00100000:3.0:1788864765.267063:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788864765.267076:0:8086:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8086:1875760546597504:0@lo:502: 00000040:00080000:2.0:1788864765.267099:0:8086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788864765.267773:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788864765.267792:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788864765.267815:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e600/0xf8c13e2d0e959103 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95910a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864765.267827:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e600/0xf8c13e2d0e959103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95910a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788864765.267916:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788864765.267919:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788864765.267922:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788864765.267951:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14200/0xf8c13e2d0e959111 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864765.268033:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14200/0xf8c13e2d0e959111 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864765.268043:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14200/0xf8c13e2d0e959111 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864765.268069:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546597632:0@lo:101: 00000100:00100000:1.0:1788864765.268108:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864765.268140:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbc4ff0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864765.268633:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546597632 00000100:00100000:0.0:1788864765.268639:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546597632 00000100:00100000:0.0:1788864765.268670:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788864765.268678:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:5832:x1875760546597632:12345-0@lo:101: 00010000:00010000:0.0:1788864765.268688:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864765.268700:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdc80030800/0xf8c13e2d0e959118 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e959111 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864765.268735:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdc80030800/0xf8c13e2d0e959118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e959111 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864765.268755:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdc80030800/0xf8c13e2d0e959118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e959111 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864765.268764:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdc80030800, rc 0) 00000100:00100000:0.0:1788864765.268819:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:5832:x1875760546597632:12345-0@lo:101: Request processed in 141us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864765.268826:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788864765.269238:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546597632:0@lo:101: 00010000:00010000:3.0:1788864765.269256:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14200/0xf8c13e2d0e959111 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959118 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864765.269266:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14200/0xf8c13e2d0e959111 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e959118 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864765.269326:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546597760:0@lo:501: 00000100:00100000:3.0:1788864765.269358:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864765.269388:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca8d28a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788864765.270302:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546597760 00000100:00100000:0.0:1788864765.270309:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546597760 00000100:00100000:0.0:1788864765.270347:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788864765.270356:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:5832:x1875760546597760:12345-0@lo:501: 00000100:00100000:0.0:1788864765.272215:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:5832:x1875760546597760:12345-0@lo:501: Request processed in 1852us (2849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864765.272227:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788864765.272315:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546597760:0@lo:501: 00000100:00100000:3.0:1788864765.272363:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546597888:0@lo:503: 00000100:00100000:3.0:1788864765.272412:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864765.272450:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca8d28a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788864765.272810:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546597888 00000100:00100000:1.0:1788864765.272817:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546597888 00000100:00100000:1.0:1788864765.272857:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788864765.272865:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:5832:x1875760546597888:12345-0@lo:503: 00000100:00100000:1.0:1788864765.273374:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:5832:x1875760546597888:12345-0@lo:503: Request processed in 508us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864765.273381:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788864765.274198:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546597888:0@lo:503: 00000100:00100000:0.0:1788864765.280668:0:8088:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8088:1875760546598016:0@lo:502: 00000100:00100000:0.0:1788864765.280778:0:8088:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864765.280822:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546598016 00000100:00100000:0.0:1788864765.280829:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546598016 00000100:00100000:0.0:1788864765.280872:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788864765.280882:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:8088:x1875760546598016:12345-0@lo:502: 00000100:00100000:0.0:1788864765.281153:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:8088:x1875760546598016:12345-0@lo:502: Request processed in 272us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864765.281161:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788864765.281207:0:8088:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcb5307480 going to sleep for 11 seconds 00000100:00100000:0.0:1788864765.281232:0:8088:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8088:1875760546598016:0@lo:502: 00000020:01000000:0.0:1788864765.281258:0:8088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788864765.281266:0:8088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864765.281268:0:8088:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788864765.281273:0:8088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788864765.281275:0:8088:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788864765.281290:0:8088:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8088:1875760546598144:0@lo:502: 00000100:00100000:0.0:1788864765.281322:0:8088:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864765.281346:0:8088:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcb5307480 going to sleep for 11 seconds 00000100:00100000:1.0:1788864765.281741:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546598144 00000100:00100000:1.0:1788864765.281747:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546598144 00000100:00100000:1.0:1788864765.281781:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788864765.281790:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:8088:x1875760546598144:12345-0@lo:502: 00000100:00100000:1.0:1788864765.282196:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:8088:x1875760546598144:12345-0@lo:502: Request processed in 406us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864765.282205:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788864765.282414:0:8088:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8088:1875760546598144:0@lo:502: 00000020:01000000:2.0:1788864765.282442:0:8088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864765.282447:0:8088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864765.282449:0:8088:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788864765.282454:0:8088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1788864765.282555:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788864765.282574:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788864765.282584:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14200/0xf8c13e2d0e959111 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959118 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864765.282596:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14200/0xf8c13e2d0e959111 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959118 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864765.282607:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788864765.282609:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fdc8878e000 from 30 10000000:01000000:3.0:1788864765.282612:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788864765.282638:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95911f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864765.282655:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95911f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864765.282664:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95911f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864765.282678:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546598272:0@lo:101: 00000100:00100000:3.0:1788864765.283018:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864765.284177:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca8d28780 going to sleep for 11 seconds 00000100:00100000:1.0:1788864765.290394:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546598272 00000100:00100000:1.0:1788864765.290408:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546598272 00000100:00100000:1.0:1788864765.290484:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788864765.290494:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:5832:x1875760546598272:12345-0@lo:101: 00010000:00010000:1.0:1788864765.290509:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864765.290527:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdca4d14e00/0xf8c13e2d0e959126 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95911f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864765.290554:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdca4d14e00/0xf8c13e2d0e959126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95911f expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864765.291273:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdca4d14e00/0xf8c13e2d0e959126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95911f expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864765.291283:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca4d14e00, rc 0) 00000100:00100000:1.0:1788864765.291371:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:5832:x1875760546598272:12345-0@lo:101: Request processed in 879us (8353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864765.291379:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788864765.291594:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546598272:0@lo:101: 00010000:00010000:3.0:1788864765.291615:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95911f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959126 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864765.291626:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95911f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e959126 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864765.291696:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546598400:0@lo:501: 00000100:00100000:3.0:1788864765.291767:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864765.291799:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca8d28780 going to sleep for 11 seconds 00000100:00100000:1.0:1788864765.291984:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546598400 00000100:00100000:1.0:1788864765.291990:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546598400 00000100:00100000:1.0:1788864765.292024:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788864765.292031:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:5832:x1875760546598400:12345-0@lo:501: 00000100:00100000:1.0:1788864765.292274:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:5832:x1875760546598400:12345-0@lo:501: Request processed in 243us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864765.292282:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788864765.292600:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546598400:0@lo:501: 00000100:00100000:3.0:1788864765.292632:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546598528:0@lo:503: 00000100:00100000:3.0:1788864765.292672:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864765.292700:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca8d28780 going to sleep for 11 seconds 00000100:00100000:1.0:1788864765.293575:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546598528 00000100:00100000:1.0:1788864765.293584:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546598528 00000100:00100000:1.0:1788864765.293632:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788864765.293640:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:5832:x1875760546598528:12345-0@lo:503: 00000100:00100000:1.0:1788864765.293979:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:5832:x1875760546598528:12345-0@lo:503: Request processed in 339us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864765.293987:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788864765.294072:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546598528:0@lo:503: 00000100:00100000:0.0:1788864765.302739:0:8091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbedc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8091:1875760546598656:0@lo:502: 00000100:00100000:0.0:1788864765.302818:0:8091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864765.302869:0:8091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcb53076c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864765.302912:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546598656 00000100:00100000:1.0:1788864765.302920:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546598656 00000100:00100000:1.0:1788864765.302973:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788864765.302983:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:8091:x1875760546598656:12345-0@lo:502: 00000100:00100000:1.0:1788864765.303954:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:8091:x1875760546598656:12345-0@lo:502: Request processed in 968us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864765.303974:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788864765.307319:0:8091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbedc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8091:1875760546598656:0@lo:502: 00000100:00100000:0.0:1788864765.307401:0:8091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbedc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8091:1875760546598784:0@lo:502: 00000100:00100000:0.0:1788864765.307466:0:8091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864765.307499:0:8091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcb53076c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864765.308237:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546598784 00000100:00100000:1.0:1788864765.308246:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546598784 00000100:00100000:1.0:1788864765.308304:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788864765.308314:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:8091:x1875760546598784:12345-0@lo:502: 00000100:00100000:1.0:1788864765.309540:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:8091:x1875760546598784:12345-0@lo:502: Request processed in 1224us (2072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864765.309550:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788864765.309788:0:8091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbedc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8091:1875760546598784:0@lo:502: 00000040:00080000:3.0:1788864765.309821:0:8091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788864765.310330:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788864765.310347:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788864765.310357:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95911f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959126 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864765.310368:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95911f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959126 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864765.310377:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788864765.310380:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fdc8878e000 from 5 10000000:01000000:2.0:1788864765.310382:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788864765.310412:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044200/0xf8c13e2d0e95912d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864765.310420:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044200/0xf8c13e2d0e95912d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864765.310435:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044200/0xf8c13e2d0e95912d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864765.310455:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546598912:0@lo:101: 00000100:00100000:2.0:1788864765.310496:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864765.310534:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc860b56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788864765.311132:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546598912 00000100:00100000:3.0:1788864765.311141:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546598912 00000100:00100000:3.0:1788864765.311180:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788864765.311191:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:5832:x1875760546598912:12345-0@lo:101: 00010000:00010000:3.0:1788864765.311204:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864765.311218:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdb8213e800/0xf8c13e2d0e959134 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95912d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864765.311242:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdb8213e800/0xf8c13e2d0e959134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95912d expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864765.311252:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdb8213e800/0xf8c13e2d0e959134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95912d expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864765.311260:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213e800, rc 0) 00000100:00100000:3.0:1788864765.311304:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546598912:12345-0@lo:101: Request processed in 115us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864765.311311:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788864765.311354:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546598912:0@lo:101: 00010000:00010000:3.0:1788864765.311369:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044200/0xf8c13e2d0e95912d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959134 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864765.311379:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044200/0xf8c13e2d0e95912d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e959134 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864765.311431:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546599040:0@lo:256: 00000100:00100000:3.0:1788864765.311462:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864765.311481:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca8d28180 going to sleep for 11 seconds 00000100:00100000:1.0:1788864765.312080:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546599040 00000100:00100000:1.0:1788864765.312085:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546599040 00000100:00100000:1.0:1788864765.312115:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788864765.312122:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546599040:12345-0@lo:256: 20000000:01000000:1.0:1788864765.312135:0:5827:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788864765.312150:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788864765.312153:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788864765.312224:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546599040:12345-0@lo:256: Request processed in 103us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864765.312231:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788864765.312260:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546599040:0@lo:256: 10000000:01000000:1.0:1788864765.312295:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788864765.312301:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044200/0xf8c13e2d0e95912d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959134 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864765.312309:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044200/0xf8c13e2d0e95912d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959134 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788864765.312318:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788864765.312323:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788864765.312326:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788864765.312344:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15c00/0xf8c13e2d0e95913b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864765.312352:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15c00/0xf8c13e2d0e95913b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864765.312360:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15c00/0xf8c13e2d0e95913b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864765.312371:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546599168:0@lo:101: 00000100:00100000:1.0:1788864765.312393:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864765.312412:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1505c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788864765.312421:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546599168 00000100:00100000:1.0:1788864765.312424:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546599168 00000100:00100000:1.0:1788864765.312438:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788864765.312443:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546599168:12345-0@lo:101: 00010000:00010000:1.0:1788864765.312449:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864765.312457:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdca4d14800/0xf8c13e2d0e959142 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95913b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864765.312472:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdca4d14800/0xf8c13e2d0e959142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95913b expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864765.312480:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdca4d14800/0xf8c13e2d0e959142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95913b expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864765.312488:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca4d14800, rc 0) 00000100:00100000:1.0:1788864765.312508:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546599168:12345-0@lo:101: Request processed in 65us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864765.312518:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788864765.312540:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546599168:0@lo:101: 00010000:00010000:1.0:1788864765.313659:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15c00/0xf8c13e2d0e95913b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959142 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864765.313672:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15c00/0xf8c13e2d0e95913b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e959142 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864765.313756:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546599296:0@lo:501: 00000100:00100000:1.0:1788864765.313797:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864765.313903:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1505c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788864765.313926:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546599296 00000100:00100000:1.0:1788864765.313932:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546599296 00000100:00100000:1.0:1788864765.314080:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788864765.314089:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546599296:12345-0@lo:501: 00000100:00100000:1.0:1788864765.315660:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546599296:12345-0@lo:501: Request processed in 1567us (1857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864765.315673:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788864765.319067:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546599296:0@lo:501: 00000100:00100000:3.0:1788864765.323117:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546599424:0@lo:503: 00000100:00100000:3.0:1788864765.323208:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864765.323242:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca8d28cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788864765.323259:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546599424 00000100:00100000:3.0:1788864765.323268:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546599424 00000100:00100000:3.0:1788864765.323314:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788864765.323322:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546599424:12345-0@lo:503: 00000100:00100000:3.0:1788864765.324791:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546599424:12345-0@lo:503: Request processed in 1465us (1578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864765.324803:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788864765.324865:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546599424:0@lo:503: 00000100:00100000:3.0:1788864765.325056:0:8094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8094:1875760546599552:0@lo:502: 00000100:00100000:3.0:1788864765.325095:0:8094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864765.325118:0:8094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca8d28180 going to sleep for 11 seconds 00000100:00100000:1.0:1788864765.325810:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546599552 00000100:00100000:1.0:1788864765.325819:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546599552 00000100:00100000:1.0:1788864765.326650:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788864765.326661:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:8094:x1875760546599552:12345-0@lo:502: 00000100:00100000:1.0:1788864765.327255:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:8094:x1875760546599552:12345-0@lo:502: Request processed in 595us (2159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864765.327263:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788864765.333047:0:8094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8094:1875760546599552:0@lo:502: 00000020:01000000:3.0:1788864765.333362:0:8094:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788864765.333370:0:8094:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788864765.333377:0:8094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864765.333380:0:8094:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788864765.333398:0:8094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788864765.333403:0:8094:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:3.0:1788864765.333426:0:8094:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788864765.333429:0:8094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788864765.333444:0:8094:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9fdc909999c0) 00000020:00000080:3.0:1788864765.333466:0:8094:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788864765.333473:0:8094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788864765.333551:0:8094:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788864765.334471:0:8094:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788864765.334492:0:8094:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf8c13e2d0e959150 00010000:00080000:3.0:1788864765.334523:0:8094:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fdcbffeb000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:3.0:1788864765.335497:0:8094:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1788864765.335905:0:8094:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788864765.335919:0:8094:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788864765.336419:0:8094:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788864765.336630:0:8094:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788864765.336682:0:8094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788864765.336761:0:8094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788864765.348677:0:8096:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788864765.348689:0:8096:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788864765.352818:0:8094:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788864765.352834:0:8094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788864765.352875:0:8094:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788864765.352913:0:8094:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf8c13e2d0e959157 00000100:00080000:3.0:1788864765.352925:0:8094:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788864765.352936:0:8094:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fdcbffeb000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788864765.352972:0:8094:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fdca003ed80 x1875760546599680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788864765.353002:0:8094:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788864765.353114:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875760546599680:0@lo:8: 00000100:00100000:1.0:1788864765.353352:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546600192:0@lo:400: 00000100:00100000:2.0:1788864765.353353:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875760546599808:0@lo:400: 00000100:00100000:2.0:1788864765.353415:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788864765.353458:0:8094:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788864765.353463:0:8094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864765.353465:0:8094:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788864765.353468:0:8094:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788864765.353472:0:8094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864765.353474:0:8094:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788864765.353476:0:8094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788864765.353478:0:8094:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788864765.353503:0:8094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8094:1875760546600320:0@lo:502: 00000100:00100000:2.0:1788864765.353531:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546599936:0@lo:400: 00000100:00100000:3.0:1788864765.353552:0:8094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864765.354598:0:8094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca8d28300 going to sleep for 11 seconds 00000100:00100000:1.0:1788864765.354605:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864765.354661:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546599808 00000100:00100000:1.0:1788864765.354669:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546599808 00000100:00100000:2.0:1788864765.354724:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864765.354759:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788864765.354769:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546600064:0@lo:400: 00000100:00100000:1.0:1788864765.354769:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546600192 00000100:00100000:1.0:1788864765.354774:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546600192 00000100:00100000:2.0:1788864765.354807:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864765.354856:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546599936 00000100:00100000:3.0:1788864765.354862:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546599936 00000100:00100000:1.0:1788864765.354862:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788864765.354873:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546600064 00000100:00100000:1.0:1788864765.354879:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875760546599808:12345-0@lo:400: 00000100:00100000:2.0:1788864765.354880:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546600064 00000100:00100000:2.0:1788864765.354934:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788864765.354944:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546600064:12345-0@lo:400: 00000100:00100000:2.0:1788864765.354987:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546600064:12345-0@lo:400: Request processed in 45us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864765.354995:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788864765.355025:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875760546599808:12345-0@lo:400: Request processed in 81us (1539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864765.355034:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788864765.355041:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdca003f100 x1875760546599808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864765.355055:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788864765.355059:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875760546599808:0@lo:400: 00000100:00100000:1.0:1788864765.355066:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbba7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546600192:12345-0@lo:400: 00000100:00100000:2.0:1788864765.355089:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864765.355127:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbba7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546600192:12345-0@lo:400: Request processed in 63us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864765.355131:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546599680 00000100:00100000:1.0:1788864765.355135:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788864765.355146:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546599680 00000100:00100000:1.0:1788864765.355152:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788864765.355161:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546599936:12345-0@lo:400: 00000100:00100000:2.0:1788864765.355171:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788864765.355178:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3299:x1875760546599680:12345-0@lo:8: 00000100:00100000:1.0:1788864765.355194:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546599936:12345-0@lo:400: Request processed in 34us (488us total) trans 0 rc 0/0 00010000:00080000:2.0:1788864765.355202:0:6685:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 188 last 0 00000100:00100000:1.0:1788864765.355203:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788864765.355228:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1788864765.355240:0:6685:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf8c13e2d0e95915e 00000100:00100000:1.0:1788864765.355243:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546600320 00000100:00100000:1.0:1788864765.355249:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546600320 00002000:00100000:2.0:1788864765.355253:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9fdc9081b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788864765.355259:0:6685:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1788864765.355263:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788864765.355280:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00010000:00080000:0.0:1788864765.355287:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdca003fb80 x1875760546600192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864765.355292:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:8094:x1875760546600320:12345-0@lo:502: 00000100:00100000:0.0:1788864765.355307:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546600192:0@lo:400: 00002000:00100000:2.0:1788864765.355541:0:6685:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788864765.355570:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:8094:x1875760546600320:12345-0@lo:502: Request processed in 282us (2018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864765.355587:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788864765.355768:0:8094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8094:1875760546600320:0@lo:502: 00000020:01000000:0.0:1788864765.355798:0:8094:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788864765.355806:0:8094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864765.355808:0:8094:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00002000:00080000:2.0:1788864765.355812:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000040:00080000:0.0:1788864765.355821:0:8094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00080000:2.0:1788864765.355837:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9fdc90818800 : changing import state from RECOVER to FULL 00000020:01000000:0.0:1788864765.355882:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 00000100:00100000:2.0:1788864765.355883:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1875760546599680:12345-0@lo:8: Request processed in 703us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864765.355904:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 10000000:01000000:0.0:1788864765.355928:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788864765.355939:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15c00/0xf8c13e2d0e95913b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959142 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864765.355952:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15c00/0xf8c13e2d0e95913b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959142 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1788864765.355959:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdca003ed80 x1875760546599680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788864775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788864765.355965:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788864765.355969:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fdca1ff4d40 from 1 00000100:00100000:2.0:1788864765.355971:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 10000000:01000000:0.0:1788864765.355974:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00080000:2.0:1788864765.355978:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788864765.355987:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788864765.355992:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788864765.355994:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fdcbffeb000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00010000:00010000:0.0:1788864765.356003:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959165 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788864765.356008:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00010000:00010000:0.0:1788864765.356012:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959165 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864765.356015:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875760546599680:0@lo:8: 00010000:00010000:0.0:1788864765.356028:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959165 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1788864765.356044:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdca003ca80 x1875760546600064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864765.356047:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546600448:0@lo:101: 00000100:00100000:2.0:1788864765.356059:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546600064:0@lo:400: 00010000:00080000:2.0:1788864765.356082:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdca003d880 x1875760546599936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864765.356091:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546599936:0@lo:400: 00000100:00100000:0.0:1788864765.356104:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788864765.356115:0:8096:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788864765.356125:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcb53076c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864765.356143:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546600448 00000100:00100000:0.0:1788864765.356148:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546600448 00000100:00100000:0.0:1788864765.356185:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788864765.356194:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546600448:12345-0@lo:101: 00010000:00010000:0.0:1788864765.356202:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864765.356214:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdc80031200/0xf8c13e2d0e95916c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e959165 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788864765.356225:0:8096:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 188487520477ns, next at 0ns, rc = 0 00010000:00010000:0.0:1788864765.356246:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdc80031200/0xf8c13e2d0e95916c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e959165 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864765.356257:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdc80031200/0xf8c13e2d0e95916c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e959165 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864765.356265:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdc80031200, rc 0) 00000100:00100000:0.0:1788864765.356302:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:5832:x1875760546600448:12345-0@lo:101: Request processed in 110us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864765.356319:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788864765.356354:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546600448:0@lo:101: 00010000:00010000:0.0:1788864765.356367:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959165 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95916c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864765.356376:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959165 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95916c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864765.356427:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546600576:0@lo:501: 00000100:00100000:0.0:1788864765.356454:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864765.356473:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcb53076c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864765.356476:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546600576 00000100:00100000:1.0:1788864765.356482:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546600576 00000100:00100000:1.0:1788864765.356513:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788864765.356523:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:5832:x1875760546600576:12345-0@lo:501: 00000100:00100000:1.0:1788864765.356772:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:5832:x1875760546600576:12345-0@lo:501: Request processed in 250us (314us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788864765.356779:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788864765.356817:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546600576:0@lo:501: 10000000:01000000:1.0:1788864765.356839:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788864765.356846:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959165 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95916c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864765.356855:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95916c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788864765.421489:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788864765.474355:0:8097:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788864765.474384:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8097:1875760546600832:0@lo:7: 00000100:00100000:2.0:1788864765.474549:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864765.474601:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbc4ff840 going to sleep for 11 seconds 00000100:00100000:2.0:1788864765.474631:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546600704:0@lo:13: 00000100:00100000:2.0:1788864765.474656:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864765.474695:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546600704 00000100:00100000:2.0:1788864765.474726:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546600704 00000100:00100000:2.0:1788864765.474779:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788864765.474788:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875760546600704:12345-0@lo:13: 00002000:00000024:2.0:1788864765.474822:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788864765.474865:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875760546600704:12345-0@lo:13: Request processed in 78us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864765.474872:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788864765.474904:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788864765.474933:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcbc7e1880 x1875760546600704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864765.474950:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546600704:0@lo:13: 00000100:00100000:1.0:1788864765.475013:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546600832 00000100:00100000:1.0:1788864765.475018:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546600832 00000100:00100000:1.0:1788864765.475051:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788864765.475058:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8097:x1875760546600832:12345-0@lo:7: 00002000:00080000:2.0:1788864765.485677:0:6684:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788864765.485685:0:6684:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788864765.485832:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8097:x1875760546600832:12345-0@lo:7: Request processed in 10771us (11280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864765.485849:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788864765.488811:0:8097:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcbc7e0a80 x1875760546600832/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788864781 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864765.488829:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8097:1875760546600832:0@lo:7: 00000004:00080000:0.0:1788864765.488844:0:8097:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788864765.490531:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8097:1875760546600960:0@lo:5: 00000100:00100000:2.0:1788864765.490589:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864765.490671:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbc4ffcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864765.490835:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546600960 00000100:00100000:0.0:1788864765.490849:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546600960 00000100:00100000:0.0:1788864765.490925:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788864765.490933:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8097:x1875760546600960:12345-0@lo:5: 00002000:00080000:0.0:1788864765.490956:0:6682:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788864765.490959:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788864765.491250:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8097:x1875760546600960:12345-0@lo:5: Request processed in 316us (658us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788864765.491257:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788864765.491322:0:8097:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcbc7e1880 x1875760546600960/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788864781 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864765.491335:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8097:1875760546600960:0@lo:5: 00000004:00080000:1.0:1788864765.491346:0:8097:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788864765.491369:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8097:1875760546601088:0@lo:700: 00000100:00100000:1.0:1788864765.491412:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864765.491427:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfdfb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864765.491530:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546601088 00000100:00100000:0.0:1788864765.491534:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546601088 00000100:00100000:0.0:1788864765.491588:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788864765.491595:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbba7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8097:x1875760546601088:12345-0@lo:700: 00000100:00100000:0.0:1788864765.491619:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6691:1875760546601216:0@lo:700: 00000100:00100000:0.0:1788864765.491642:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864765.491662:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbc5c99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864765.491727:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546601216 00000100:00100000:1.0:1788864765.491731:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546601216 00000100:00100000:1.0:1788864765.491761:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788864765.491767:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6691:x1875760546601216:12345-0@lo:700: 00010000:00010000:1.0:1788864765.509639:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:1.0:1788864765.516094:0:5842:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788864765.521955:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6691:x1875760546601216:12345-0@lo:700: Request processed in 30179us (30303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864765.521968:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788864765.522090:0:6691:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcacbedf80 x1875760546601216/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788864781 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864765.522105:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6691:1875760546601216:0@lo:700: 40000000:02000000:0.0:1788864765.522118:0:6691:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:1.0:1788864765.587173:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1788864765.587218:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788864765.587325:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbba7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8097:x1875760546601088:12345-0@lo:700: Request processed in 95726us (95908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864765.587357:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788864765.588169:0:8097:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcbba7c700 x1875760546601088/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788864781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864765.588182:0:8097:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788864765.588200:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8097:1875760546601088:0@lo:700: 00000004:02000040:1.0:1788864765.630272:0:8097:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1788864765.639567:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8097:1875760546601344:0@lo:5: 00000100:00100000:1.0:1788864765.639635:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864765.639692:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfdfb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864765.640370:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546601344 00000100:00100000:0.0:1788864765.640379:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546601344 00000100:00100000:0.0:1788864765.640434:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788864765.640443:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbba7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8097:x1875760546601344:12345-0@lo:5: 00002000:00080000:0.0:1788864765.650210:0:6684:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788864765.650243:0:6684:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1788864765.660560:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbba7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8097:x1875760546601344:12345-0@lo:5: Request processed in 20110us (20916us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788864765.660585:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788864765.664468:0:8097:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcbba7c700 x1875760546601344/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788864781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864765.664488:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8097:1875760546601344:0@lo:5: 00000004:00080000:2.0:1788864765.664506:0:8097:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1788864766.535506:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788864766.888402:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:2.0:1788864767.373321:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864767.373358:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528752768 00000100:00100000:2.0:1788864767.373368:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528752768 00000100:00100000:2.0:1788864767.373427:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 110 00000100:00100000:2.0:1788864767.373435:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2355:x1875760528752768:12345-192.168.203.13@tcp:250: 00010000:00080000:2.0:1788864767.373463:0:5830:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 202cc404-00bb-4314-9125-b9b0b45f494c@192.168.203.13@tcp t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:2.0:1788864767.373493:0:5830:0:(genops.c:1384:class_connect()) connect: client 202cc404-00bb-4314-9125-b9b0b45f494c, cookie 0xf8c13e2d0e959173 00000100:00080000:2.0:1788864767.373626:0:5830:0:(import.c:65:import_set_state_nolock()) ffff9fdc90819000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788864767.373690:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+5:2355:x1875760528752768:12345-192.168.203.13@tcp:250: Request processed in 254us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864767.373698:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 110 00000100:00100000:0.0:1788864767.382799:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864767.382994:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528752896 00000100:00100000:1.0:1788864767.383003:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528752896 00000100:00100000:1.0:1788864767.383062:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 111 00000100:00100000:1.0:1788864767.383073:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+5:5583:x1875760528752896:12345-192.168.203.13@tcp:101: 00010000:00010000:1.0:1788864767.383088:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864767.383104:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdca4d14400/0xf8c13e2d0e95917a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c2384dba975f9ba expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864767.383130:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdca4d14400/0xf8c13e2d0e95917a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9ba expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864767.383140:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdca4d14400/0xf8c13e2d0e95917a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9ba expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864767.383148:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca4d14400, rc 0) 00000100:00100000:1.0:1788864767.383196:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+6:5583:x1875760528752896:12345-192.168.203.13@tcp:101: Request processed in 125us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864767.383203:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 111 00000100:00100000:3.0:1788864767.394822:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864767.400217:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528753024 00000100:00100000:1.0:1788864767.400232:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528753024 00000100:00100000:2.0:1788864767.402122:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 112 00000100:00100000:2.0:1788864767.402136:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+6:5583:x1875760528753024:12345-192.168.203.13@tcp:501: 00000100:00100000:2.0:1788864767.402554:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+6:5583:x1875760528753024:12345-192.168.203.13@tcp:501: Request processed in 418us (7738us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788864767.402574:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 112 00000100:00100000:2.0:1788864767.407394:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864767.407589:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528753152 00000100:00100000:0.0:1788864767.407611:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528753152 00000100:00100000:0.0:1788864767.407666:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:0.0:1788864767.407674:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+6:5583:x1875760528753152:12345-192.168.203.13@tcp:101: 00010000:00010000:0.0:1788864767.407689:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864767.407950:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdc80031000/0xf8c13e2d0e959181 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c2384dba975f9c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864767.407982:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdc80031000/0xf8c13e2d0e959181 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9c1 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864767.407993:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdc80031000/0xf8c13e2d0e959181 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9c1 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864767.408001:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdc80031000, rc 0) 00000100:00100000:0.0:1788864767.408518:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+7:5583:x1875760528753152:12345-192.168.203.13@tcp:101: Request processed in 842us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864767.408526:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:2.0:1788864767.412212:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864767.412297:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528753280 00000100:00100000:3.0:1788864767.412307:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528753280 00000100:00100000:3.0:1788864767.412392:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:3.0:1788864767.412402:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+7:5583:x1875760528753280:12345-192.168.203.13@tcp:501: 00000100:00100000:3.0:1788864767.412654:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+8:5583:x1875760528753280:12345-192.168.203.13@tcp:501: Request processed in 253us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864767.412662:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:0.0:1788864767.421519:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864767.421655:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528753408 00000100:00100000:3.0:1788864767.421664:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528753408 00000100:00100000:3.0:1788864767.421750:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:3.0:1788864767.421761:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+8:5583:x1875760528753408:12345-192.168.203.13@tcp:503: 00000100:00100000:3.0:1788864767.422126:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+8:5583:x1875760528753408:12345-192.168.203.13@tcp:503: Request processed in 366us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864767.422134:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:1.0:1788864767.426919:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864767.427013:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528753536 00000100:00100000:0.0:1788864767.427024:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528753536 00000100:00100000:0.0:1788864767.427085:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:0.0:1788864767.427094:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+8:5602:x1875760528753536:12345-192.168.203.13@tcp:502: 00000100:00100000:0.0:1788864767.427436:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+8:5602:x1875760528753536:12345-192.168.203.13@tcp:502: Request processed in 341us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864767.427443:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:3.0:1788864767.462658:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864767.462850:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528753664 00000100:00100000:2.0:1788864767.462861:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528753664 00000100:00100000:2.0:1788864767.462924:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:2.0:1788864767.462934:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+8:5602:x1875760528753664:12345-192.168.203.13@tcp:502: 00000100:00100000:2.0:1788864767.463302:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+8:5602:x1875760528753664:12345-192.168.203.13@tcp:502: Request processed in 368us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864767.463310:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:0.0:1788864767.471545:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864767.471780:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528753792 00000100:00100000:3.0:1788864767.471797:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528753792 00000100:00100000:3.0:1788864767.471959:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:3.0:1788864767.471972:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+8:5583:x1875760528753792:12345-192.168.203.13@tcp:101: 00010000:00010000:3.0:1788864767.471992:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864767.472483:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdb8213e200/0xf8c13e2d0e959188 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c2384dba975f9eb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864767.472546:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdb8213e200/0xf8c13e2d0e959188 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9eb expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864767.472558:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdb8213e200/0xf8c13e2d0e959188 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9eb expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864767.472569:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213e200, rc 0) 00000100:00100000:3.0:1788864767.472780:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+9:5583:x1875760528753792:12345-192.168.203.13@tcp:101: Request processed in 810us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864767.472788:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:3.0:1788864767.512560:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864767.512992:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528753920 00000100:00100000:1.0:1788864767.513006:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528753920 00000100:00100000:1.0:1788864767.513068:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:1.0:1788864767.513079:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+9:5583:x1875760528753920:12345-192.168.203.13@tcp:256: 20000000:01000000:1.0:1788864767.513111:0:5828:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788864767.513145:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788864767.513149:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788864767.513152:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788864767.513154:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788864767.524989:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+9:5583:x1875760528753920:12345-192.168.203.13@tcp:256: Request processed in 11896us (12429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864767.525010:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:0.0:1788864767.531265:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864767.533377:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528754048 00000100:00100000:3.0:1788864767.533397:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528754048 00000100:00100000:3.0:1788864767.535460:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:3.0:1788864767.535614:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+9:5583:x1875760528754048:12345-192.168.203.13@tcp:101: 00010000:00010000:3.0:1788864767.535638:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864767.535662:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e95918f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c2384dba975f9f2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864767.535716:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e95918f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9f2 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864767.535730:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e95918f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9f2 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864767.535740:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213e400, rc 0) 00000100:00100000:3.0:1788864767.538029:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+10:5583:x1875760528754048:12345-192.168.203.13@tcp:101: Request processed in 2412us (6636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864767.538061:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:3.0:1788864767.545635:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864767.545744:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528754176 00000100:00100000:1.0:1788864767.545759:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528754176 00000100:00100000:1.0:1788864767.545814:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:1.0:1788864767.545825:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+10:5583:x1875760528754176:12345-192.168.203.13@tcp:501: 00000100:00100000:1.0:1788864767.546196:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+10:5583:x1875760528754176:12345-192.168.203.13@tcp:501: Request processed in 371us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864767.546204:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:1.0:1788864767.551061:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864767.551220:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528754304 00000100:00100000:3.0:1788864767.551232:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528754304 00000100:00100000:3.0:1788864767.551332:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:3.0:1788864767.551345:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+10:5583:x1875760528754304:12345-192.168.203.13@tcp:503: 00000100:00100000:3.0:1788864767.551879:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+10:5583:x1875760528754304:12345-192.168.203.13@tcp:503: Request processed in 526us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864767.551889:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:0.0:1788864767.556366:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864767.556528:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528754432 00000100:00100000:2.0:1788864767.556540:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528754432 00000100:00100000:2.0:1788864767.556601:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:2.0:1788864767.556611:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+10:5604:x1875760528754432:12345-192.168.203.13@tcp:502: 00000100:00100000:2.0:1788864767.556947:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+10:5604:x1875760528754432:12345-192.168.203.13@tcp:502: Request processed in 335us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864767.556955:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 123 00010000:00010000:0.0:1788864767.558156:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864767.562747:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864767.562909:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528754560 00000100:00100000:1.0:1788864767.562923:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528754560 00000100:00100000:1.0:1788864767.562995:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:1.0:1788864767.563008:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+10:5604:x1875760528754560:12345-192.168.203.13@tcp:502: 00000100:00100000:1.0:1788864767.563336:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+10:5604:x1875760528754560:12345-192.168.203.13@tcp:502: Request processed in 329us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864767.563346:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:1.0:1788864767.568883:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864767.569001:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528754688 00000100:00100000:3.0:1788864767.569015:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528754688 00000100:00100000:3.0:1788864767.569079:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:3.0:1788864767.569092:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2355:x1875760528754688:12345-192.168.203.13@tcp:38: 00010000:00080000:3.0:1788864767.569131:0:5835:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:3.0:1788864767.569202:0:5835:0:(genops.c:1384:class_connect()) connect: client 1cf2dd0f-7f2d-465e-9303-244222bc89bf, cookie 0xf8c13e2d0e959196 00000004:00100000:3.0:1788864767.569241:0:5835:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788864767.569250:0:5835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788864767.600863:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9fdc9081d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788864767.601030:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2355:x1875760528754688:12345-192.168.203.13@tcp:38: Request processed in 31937us (32168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864767.601043:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00010000:00010000:3.0:1788864768.580959:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864768.620777:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864768.621351:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528754816 00000100:00100000:1.0:1788864768.621818:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864768.622407:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528754944 00000100:00100000:0.0:1788864768.622418:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528754944 00000100:00100000:0.0:1788864768.622499:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:0.0:1788864768.622511:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:5583:x1875760528754944:12345-192.168.203.13@tcp:41: 00000004:00000024:0.0:1788864768.622672:0:6705:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788864768.622793:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:5583:x1875760528754944:12345-192.168.203.13@tcp:41: Request processed in 284us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864768.622800:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00080000:2.0:1788864768.623689:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864768.624273:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528754816 00000100:00100000:3.0:1788864768.624571:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:3.0:1788864768.624581:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:0:x1875760528754816:12345-192.168.203.13@tcp:41: 00000004:00000024:3.0:1788864768.624605:0:5836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788864768.624669:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:0:x1875760528754816:12345-192.168.203.13@tcp:41: Request processed in 89us (3899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864768.624688:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1788864768.626106:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864768.628234:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528755072 00000100:00100000:2.0:1788864768.628246:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528755072 00000100:00100000:2.0:1788864768.628319:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1788864768.628330:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:5583:x1875760528755072:12345-192.168.203.13@tcp:40: 00000100:00100000:2.0:1788864768.628439:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:5583:x1875760528755072:12345-192.168.203.13@tcp:40: Request processed in 111us (2339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864768.628458:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1788864768.634210:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864768.634825:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864768.635042:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528755456 00000100:00100000:2.0:1788864768.635068:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528755456 00000100:00100000:2.0:1788864768.635260:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:2.0:1788864768.635271:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+10:2356:x1875760528755456:12345-192.168.203.13@tcp:400: 00000100:00100000:2.0:1788864768.635413:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+10:2356:x1875760528755456:12345-192.168.203.13@tcp:400: Request processed in 144us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864768.635422:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:0.0:1788864768.636034:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528755200 00000100:00100000:0.0:1788864768.636042:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528755200 00000100:00100000:0.0:1788864768.636099:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:0.0:1788864768.636105:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1875760528755200:12345-192.168.203.13@tcp:8: 00010000:00080000:0.0:1788864768.636131:0:6682:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:0.0:1788864768.636163:0:6682:0:(genops.c:1384:class_connect()) connect: client 1cf2dd0f-7f2d-465e-9303-244222bc89bf, cookie 0xf8c13e2d0e95919d 00002000:00100000:0.0:1788864768.636176:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1cf2dd0f-7f2d-465e-9303-244222bc89bf/ffff9fdb819b1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788864768.636200:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788864768.636535:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788864768.636576:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9fdb819b0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788864768.636617:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2355:x1875760528755200:12345-192.168.203.13@tcp:8: Request processed in 511us (2421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864768.636625:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:1.0:1788864768.638157:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864768.638763:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528755584 00000100:00100000:0.0:1788864768.638775:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528755584 00000100:00100000:0.0:1788864768.638850:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:0.0:1788864768.638874:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:5583:x1875760528755584:12345-192.168.203.13@tcp:33: 00000100:00100000:1.0:1788864768.651859:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864768.652478:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528755328 00000100:00100000:2.0:1788864768.652493:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528755328 00000100:00100000:2.0:1788864768.652557:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:2.0:1788864768.652567:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1875760528755328:12345-192.168.203.13@tcp:8: 00010000:00080000:2.0:1788864768.652612:0:6684:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:2.0:1788864768.652654:0:6684:0:(genops.c:1384:class_connect()) connect: client 1cf2dd0f-7f2d-465e-9303-244222bc89bf, cookie 0xf8c13e2d0e9591a4 00002000:00100000:2.0:1788864768.652668:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1cf2dd0f-7f2d-465e-9303-244222bc89bf/ffff9fdc90819800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788864768.652700:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788864768.653207:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788864768.653251:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9fdc9081c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788864768.653350:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2355:x1875760528755328:12345-192.168.203.13@tcp:8: Request processed in 782us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864768.653359:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000004:00080000:0.0:1788864768.702723:0:5838:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 63724us 00000004:00200000:1.0:1788864768.727270:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788864768.727384:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:5583:x1875760528755584:12345-192.168.203.13@tcp:33: Request processed in 88519us (89234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864768.727399:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:1.0:1788864768.939620:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864768.939765:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528755712 00000100:00100000:2.0:1788864768.939792:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528755712 00000100:00100000:2.0:1788864768.939891:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:2.0:1788864768.939902:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:5621:x1875760528755712:12345-192.168.203.13@tcp:101: 00010000:00010000:2.0:1788864768.939923:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864768.939992:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044000/0xf8c13e2d0e9591ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fa1c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864768.940055:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e9591b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864768.940070:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e9591b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864768.940098:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e9591b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864768.940132:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788864768.940136:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788864768.940153:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e9591b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864768.940178:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044000/0xf8c13e2d0e9591ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa1c expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864768.940206:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e9591b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa1c expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864768.940214:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc9124e900) 00010000:00010000:2.0:1788864768.940216:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788864768.940220:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcc2045800, rc 0) 00000100:00100000:2.0:1788864768.940289:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:5621:x1875760528755712:12345-192.168.203.13@tcp:101: Request processed in 389us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864768.940303:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:1.0:1788864769.349103:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788864769.349129:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546601472:0@lo:13: 00000100:00100000:1.0:1788864769.349194:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864769.352735:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546601472 00000100:00100000:0.0:1788864769.352749:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546601472 00000100:00100000:0.0:1788864769.352835:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788864769.352854:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546601472:12345-0@lo:13: 00002000:00000024:0.0:1788864769.352891:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788864769.352974:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546601472:12345-0@lo:13: Request processed in 122us (3779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864769.352981:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788864769.353053:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788864769.356738:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcacbedf80 x1875760546601472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864769.356767:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546601472:0@lo:13: 00010000:00010000:0.0:1788864769.605556:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864770.373094:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546601728:0@lo:400: 00000100:00100000:2.0:1788864770.373110:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875760546601856:0@lo:400: 00000100:00100000:2.0:1788864770.373168:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864770.373184:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546601984:0@lo:400: 00000100:00100000:3.0:1788864770.373223:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864770.373266:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788864770.373274:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546601600:0@lo:400: 00000100:00100000:2.0:1788864770.373291:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864770.373312:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864770.373316:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546602240:0@lo:400: 00000100:00100000:3.0:1788864770.373343:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875760546602112:0@lo:400: 00000100:00100000:2.0:1788864770.373351:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864770.373379:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864770.373390:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546601984 00000100:00100000:2.0:1788864770.373399:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546601984 00000100:00100000:3.0:1788864770.373413:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546602240 00000100:00100000:3.0:1788864770.373418:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546602240 00000100:00100000:2.0:1788864770.373446:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788864770.373506:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546601856 00000100:00100000:0.0:1788864770.373511:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546601856 00000100:00100000:1.0:1788864770.373527:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546601728 00000100:00100000:1.0:1788864770.373534:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546601728 00000100:00100000:0.0:1788864770.373545:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546602112 00000100:00100000:0.0:1788864770.373550:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546602112 00000100:00100000:1.0:1788864770.373565:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788864770.373579:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788864770.373587:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875760546601856:12345-0@lo:400: 00000100:00100000:0.0:1788864770.373601:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546601728:12345-0@lo:400: 00000100:00100000:1.0:1788864770.373656:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875760546601856:12345-0@lo:400: Request processed in 83us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864770.373665:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788864770.373673:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546601728:12345-0@lo:400: Request processed in 73us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864770.373681:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788864770.373688:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788864770.373697:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875760546602112:12345-0@lo:400: 00000100:00100000:0.0:1788864770.373744:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546601600 00000100:00100000:0.0:1788864770.373748:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546601600 00000100:00100000:0.0:1788864770.373781:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788864770.373788:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875760546602112:12345-0@lo:400: Request processed in 90us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864770.373793:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eeb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3302:x1875760546601600:12345-0@lo:400: 00000100:00100000:1.0:1788864770.373800:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788864770.373832:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eeb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3302:x1875760546601600:12345-0@lo:400: Request processed in 43us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864770.373840:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788864770.373871:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875760546601856:0@lo:400: 00000100:00100000:0.0:1788864770.373899:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546601728:0@lo:400: 00000100:00100000:1.0:1788864770.373908:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546601600:0@lo:400: 00000100:00100000:1.0:1788864770.373924:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875760546602112:0@lo:400: 00000100:00080000:0.0:1788864770.373952:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788864770.373957:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788864770.374203:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546601984:12345-0@lo:400: 00000100:00100000:2.0:1788864770.374249:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546601984:12345-0@lo:400: Request processed in 794us (1026us total) trans 0 rc 0/0 00010000:00080000:1.0:1788864770.374306:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcacbee680 x1875760546601984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864770.374318:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546601984:0@lo:400: 00000100:00100000:3.0:1788864770.374335:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788864770.374345:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788864770.374413:0:6682:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788864770.374424:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788864770.374432:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546602240:12345-0@lo:400: 00000100:00100000:0.0:1788864770.374523:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546602240:12345-0@lo:400: Request processed in 91us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864770.374531:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788864770.375100:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788864770.378257:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcacbed500 x1875760546602240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864770.378272:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788864770.378289:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546602240:0@lo:400: 00010000:00010000:3.0:1788864770.629875:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864770.885002:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788864770.885029:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546602368:0@lo:13: 00000100:00100000:3.0:1788864770.885094:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864770.885170:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546602368 00000100:00100000:0.0:1788864770.885179:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546602368 00000100:00100000:0.0:1788864770.885232:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788864770.885242:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546602368:12345-0@lo:13: 00002000:00000024:0.0:1788864770.885276:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788864770.885332:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546602368:12345-0@lo:13: Request processed in 92us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864770.885339:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788864770.885455:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcbc7e0a80 x1875760546602368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864786 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864770.885472:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546602368:0@lo:13: 00000100:00100000:1.0:1788864770.997212:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864770.997306:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528755840 00000100:00100000:2.0:1788864770.997316:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528755840 00000100:00100000:2.0:1788864770.997405:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:2.0:1788864770.997422:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:5673:x1875760528755840:12345-192.168.203.13@tcp:41: 00000100:00080000:1.0:1788864770.997442:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1788864770.997464:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788864770.997542:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:5673:x1875760528755840:12345-192.168.203.13@tcp:41: Request processed in 123us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864770.997550:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:1.0:1788864771.000593:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864771.000738:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528755968 00000100:00100000:0.0:1788864771.000747:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528755968 00000100:00100000:0.0:1788864771.000805:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:0.0:1788864771.000815:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:5673:x1875760528755968:12345-192.168.203.13@tcp:13: 00002000:00000024:0.0:1788864771.000855:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788864771.000918:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:5673:x1875760528755968:12345-192.168.203.13@tcp:13: Request processed in 104us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864771.000925:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00080000:1.0:1788864771.001385:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788864771.005906:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864771.006008:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528756096 00000100:00100000:0.0:1788864771.006019:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528756096 00000100:00100000:0.0:1788864771.006132:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:0.0:1788864771.006155:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:5673:x1875760528756096:12345-192.168.203.13@tcp:13: 00002000:00000024:0.0:1788864771.006179:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788864771.006243:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:5673:x1875760528756096:12345-192.168.203.13@tcp:13: Request processed in 90us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864771.006250:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00080000:1.0:1788864771.009787:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1788864771.461966:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1cf2dd0f-7f2d-465e-9303-244222bc89bf 00010000:00010000:0.0:1788864771.655153:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864772.677197:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788864773.006195:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1cf2dd0f-7f2d-465e-9303-244222bc89bf 00000001:00100000:3.0:1788864773.007129:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1cf2dd0f-7f2d-465e-9303-244222bc89bf 00000001:02000400:1.0:1788864773.684384:0:8286:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788864773.701957:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864774.033342:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864774.033388:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864774.033444:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864774.033551:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528756224 00000100:00100000:0.0:1788864774.033561:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528756224 00000100:00100000:1.0:1788864774.033612:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528756480 00000100:00100000:1.0:1788864774.033618:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528756480 00000100:00100000:1.0:1788864774.033682:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1788864774.033694:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2357:x1875760528756480:12345-192.168.203.13@tcp:400: 00000100:00100000:0.0:1788864774.033744:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00100000:0.0:1788864774.033754:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+10:2357:x1875760528756224:12345-192.168.203.13@tcp:400: 00000100:00100000:1.0:1788864774.033860:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2357:x1875760528756480:12345-192.168.203.13@tcp:400: Request processed in 168us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864774.033869:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:0.0:1788864774.033884:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+10:2357:x1875760528756224:12345-192.168.203.13@tcp:400: Request processed in 131us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864774.033893:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00080000:1.0:1788864774.033894:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788864774.035792:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528756352 00000100:00100000:3.0:1788864774.035815:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528756352 00000100:00100000:3.0:1788864774.035883:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:3.0:1788864774.035893:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2357:x1875760528756352:12345-192.168.203.13@tcp:400: 00000100:00100000:3.0:1788864774.035958:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2357:x1875760528756352:12345-192.168.203.13@tcp:400: Request processed in 67us (2513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864774.035965:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00080000:1.0:1788864774.036306:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788864774.041066:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864774.041181:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528756608 00000100:00100000:3.0:1788864774.041191:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528756608 00000100:00100000:3.0:1788864774.041275:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:3.0:1788864774.041287:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0363b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2357:x1875760528756608:12345-192.168.203.13@tcp:400: 00000100:00080000:1.0:1788864774.041303:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788864774.041374:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0363b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2357:x1875760528756608:12345-192.168.203.13@tcp:400: Request processed in 89us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864774.041382:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1788864774.471989:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788864774.472013:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546602496:0@lo:13: 00000100:00100000:1.0:1788864774.472077:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864774.472193:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546602496 00000100:00100000:0.0:1788864774.472202:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546602496 00000100:00100000:0.0:1788864774.472421:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788864774.472431:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546602496:12345-0@lo:13: 00002000:00000024:0.0:1788864774.472565:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788864774.472617:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546602496:12345-0@lo:13: Request processed in 187us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864774.472624:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788864774.472963:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcacbec700 x1875760546602496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864774.472982:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546602496:0@lo:13: 00000100:00080000:1.0:1788864774.473059:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788864774.729698:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864775.493402:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546602752:0@lo:400: 00000100:00100000:2.0:1788864775.493467:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864775.493509:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0360380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546603264:0@lo:400: 00000100:00100000:2.0:1788864775.493534:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864775.493563:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788864775.493568:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546602880:0@lo:400: 00000100:00100000:2.0:1788864775.493586:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864775.493616:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546603264 00000100:00100000:2.0:1788864775.493623:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546603264 00000100:00100000:2.0:1788864775.493676:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788864775.493685:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546603264:12345-0@lo:400: 00000100:00100000:2.0:1788864775.493779:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546603264:12345-0@lo:400: Request processed in 95us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864775.493786:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788864775.493826:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546602752 00000100:00100000:2.0:1788864775.493835:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546602752 00000100:00100000:2.0:1788864775.493857:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546602880 00000100:00100000:2.0:1788864775.493860:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546602880 00000100:00100000:2.0:1788864775.493878:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788864775.493892:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546602752:12345-0@lo:400: 00000100:00100000:2.0:1788864775.493929:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546602752:12345-0@lo:400: Request processed in 39us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864775.493935:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788864775.493953:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788864775.493969:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546602880:12345-0@lo:400: 00000100:00100000:2.0:1788864775.494005:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546602880:12345-0@lo:400: Request processed in 37us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864775.494017:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788864775.494033:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788864775.494037:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788864775.494071:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546602880:0@lo:400: 00000100:00100000:2.0:1788864775.494090:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546602752:0@lo:400: 00010000:00080000:2.0:1788864775.494101:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcc0360380 x1875760546603264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864775.494220:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0361180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546603008:0@lo:400: 00000100:00100000:3.0:1788864775.494257:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864775.494283:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788864775.494289:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0360a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546602624:0@lo:400: 00000100:00100000:3.0:1788864775.494325:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864775.494350:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875760546603136:0@lo:400: 00000100:00100000:3.0:1788864775.494379:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864775.494411:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546603136 00000100:00100000:3.0:1788864775.494414:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546603136 00000100:00100000:3.0:1788864775.494449:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788864775.494455:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875760546603136:12345-0@lo:400: 00000100:00100000:3.0:1788864775.494504:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875760546603136:12345-0@lo:400: Request processed in 49us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864775.494520:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788864775.494543:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546603008 00000100:00100000:3.0:1788864775.494546:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546603008 00000100:00100000:3.0:1788864775.494578:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788864775.494586:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546603008:12345-0@lo:400: 00000100:00100000:3.0:1788864775.494623:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546603008:12345-0@lo:400: Request processed in 38us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864775.494628:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788864775.494650:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864775.494675:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875760546603136:0@lo:400: 00010000:00080000:3.0:1788864775.494687:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcc0361180 x1875760546603008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864775.494694:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0361180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546603008:0@lo:400: 00000100:00100000:2.0:1788864775.495444:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0360380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546603264:0@lo:400: 00000100:00100000:0.0:1788864775.495880:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546602624 00000100:00100000:0.0:1788864775.495886:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546602624 00000100:00100000:0.0:1788864775.495921:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788864775.495929:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3302:x1875760546602624:12345-0@lo:400: 00000100:00100000:0.0:1788864775.496143:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3302:x1875760546602624:12345-0@lo:400: Request processed in 214us (1817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864775.496150:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788864775.496221:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0360a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546602624:0@lo:400: 00010000:00010000:0.0:1788864775.749634:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864776.010297:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788864776.010322:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfe08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546603392:0@lo:13: 00000100:00100000:1.0:1788864776.010389:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864776.010475:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546603392 00000100:00100000:1.0:1788864776.010483:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546603392 00000100:00100000:1.0:1788864776.010532:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788864776.010542:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546603392:12345-0@lo:13: 00002000:00000024:1.0:1788864776.010577:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788864776.010622:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546603392:12345-0@lo:13: Request processed in 80us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864776.010629:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788864776.010672:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcbfe08380 x1875760546603392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864776.010691:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfe08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546603392:0@lo:13: 00010000:00010000:0.0:1788864776.774728:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788864777.013073:0:8434:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce9536420 20000000:00000080:2.0:1788864777.013091:0:8434:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fdcc0656800 uarg=0000000000000000 20000000:01000000:2.0:1788864777.013128:0:8434:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788864777.013131:0:8434:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788864777.013134:0:8434:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788864777.013138:0:8434:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788864777.013203:0:8434:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788864777.013217:0:8434:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788864777.013232:0:8434:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788864777.013547:0:8434:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788864777.013550:0:8434:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788864777.015667:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788864777.016457:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788864777.016511:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788864777.016566:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1788864777.016580:0:8434:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788864777.016583:0:8434:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788864777.017529:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788864777.018089:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788864777.018145:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788864777.018183:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1788864777.018199:0:8434:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788864777.018202:0:8434:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788864777.018784:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1788864777.019564:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1788864777.019607:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1788864777.019637:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1788864777.019660:0:8434:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788864777.019663:0:8434:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788864777.020949:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788864777.021418:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788864777.021521:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788864777.021563:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1788864777.021613:0:8434:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788864777.022305:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fdb8213f800/0xf8c13e2d0e9591b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864777.022325:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdc81497c00/0xf8c13e2d0e9590b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e9590af expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864777.022334:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdca4d14c00/0xf8c13e2d0e9590e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e9590d9 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864777.022341:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdc80030000/0xf8c13e2d0e95910a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e959103 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864777.022348:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdc80030800/0xf8c13e2d0e959118 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e959111 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864777.022367:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdca4d14e00/0xf8c13e2d0e959126 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95911f expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864777.022374:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdca4d14800/0xf8c13e2d0e959142 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95913b expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864777.022381:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdc80031200/0xf8c13e2d0e95916c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e959165 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864777.022390:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdca4d14400/0xf8c13e2d0e95917a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9ba expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864777.022397:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdc80031000/0xf8c13e2d0e959181 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9c1 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864777.022403:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fdb8213f800/0xf8c13e2d0e9591b9 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864777.022464:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdc80031000/0xf8c13e2d0e959181 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9c1 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864777.022480:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fdc80031000/0xf8c13e2d0e959181 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9c1 expref: 9 pid: 5830 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864777.022494:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875760546603520:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788864777.022634:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdca4d14400/0xf8c13e2d0e95917a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9ba expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864777.022643:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fdca4d14400/0xf8c13e2d0e95917a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9ba expref: 9 pid: 5828 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864777.022652:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875760546603648:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788864777.022685:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdc80031200/0xf8c13e2d0e95916c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e959165 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864777.022693:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fdc80031200/0xf8c13e2d0e95916c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e959165 expref: 18 pid: 5830 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864777.022730:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875760546603776:0@lo:104: 00000100:00100000:3.0:1788864777.022768:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788864777.022802:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdca4d14800/0xf8c13e2d0e959142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e95913b expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864777.022825:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fdca4d14800/0xf8c13e2d0e959142 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e95913b expref: 18 pid: 5827 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864777.022846:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875760546603904:0@lo:104: 00000100:00100000:3.0:1788864777.022869:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788864777.022898:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdca4d14e00/0xf8c13e2d0e959126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e95911f expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864777.022906:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fdca4d14e00/0xf8c13e2d0e959126 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e95911f expref: 18 pid: 5828 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864777.022913:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875760546604032:0@lo:104: 00010000:00010000:3.0:1788864777.022936:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdc80030800/0xf8c13e2d0e959118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e959111 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864777.022943:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fdc80030800/0xf8c13e2d0e959118 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e959111 expref: 18 pid: 5828 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864777.022951:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875760546604160:0@lo:104: 00010000:00010000:3.0:1788864777.022971:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdc80030000/0xf8c13e2d0e95910a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e959103 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864777.022978:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fdc80030000/0xf8c13e2d0e95910a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e959103 expref: 18 pid: 5827 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864777.022986:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875760546604288:0@lo:104: 00010000:00010000:3.0:1788864777.023021:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdca4d14c00/0xf8c13e2d0e9590e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e9590d9 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864777.023030:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fdca4d14c00/0xf8c13e2d0e9590e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e9590d9 expref: 18 pid: 5827 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864777.023049:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0638a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875760546604416:0@lo:104: 00010000:00010000:3.0:1788864777.023075:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdc81497c00/0xf8c13e2d0e9590b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e9590af expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864777.023083:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fdc81497c00/0xf8c13e2d0e9590b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e9590af expref: 18 pid: 5830 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864777.023091:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0639880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875760546604544:0@lo:104: 00000100:00100000:3.0:1788864777.023109:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc87333480 going to sleep for 11 seconds 00000100:00100000:0.0:1788864777.023439:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788864777.023458:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864777.023469:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864777.023477:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864777.023484:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864777.023492:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864777.023510:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546603776 00000100:00100000:0.0:1788864777.023517:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546603776 00000100:00100000:0.0:1788864777.023551:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546603904 00000100:00100000:0.0:1788864777.023554:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546603904 00000100:00100000:0.0:1788864777.023565:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546604032 00000100:00100000:0.0:1788864777.023567:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546604032 00000100:00100000:0.0:1788864777.023577:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546604160 00000100:00100000:0.0:1788864777.023579:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546604160 00000100:00100000:0.0:1788864777.023588:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546604288 00000100:00100000:0.0:1788864777.023591:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546604288 00000100:00100000:0.0:1788864777.023599:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546604416 00000100:00100000:0.0:1788864777.023601:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546604416 00000100:00100000:0.0:1788864777.023610:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546604544 00000100:00100000:0.0:1788864777.023612:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546604544 00000100:00100000:0.0:1788864777.023624:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788864777.023633:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+9:8434:x1875760546603776:12345-0@lo:104: 00010000:00010000:0.0:1788864777.023650:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e95916c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.023735:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788864777.023741:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+9:8434:x1875760546603776:12345-0@lo:104: Request processed in 109us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864777.023747:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788864777.023766:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788864777.023772:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc009e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+8:8434:x1875760546603904:12345-0@lo:104: 00010000:00010000:0.0:1788864777.023779:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15c00/0xf8c13e2d0e95913b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e959142 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.023823:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788864777.023828:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc009e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+8:8434:x1875760546603904:12345-0@lo:104: Request processed in 57us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864777.023834:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788864777.023866:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788864777.023871:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+7:8434:x1875760546604032:12345-0@lo:104: 00010000:00010000:0.0:1788864777.023879:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95911f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e959126 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.023904:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788864777.023909:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+7:8434:x1875760546604032:12345-0@lo:104: Request processed in 38us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864777.023914:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788864777.023931:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788864777.023936:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+6:8434:x1875760546604160:12345-0@lo:104: 00010000:00010000:0.0:1788864777.023948:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14200/0xf8c13e2d0e959111 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e959118 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.023975:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788864777.023980:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+6:8434:x1875760546604160:12345-0@lo:104: Request processed in 44us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864777.023986:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788864777.023999:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788864777.024004:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+5:8434:x1875760546604288:12345-0@lo:104: 00010000:00010000:0.0:1788864777.024011:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e600/0xf8c13e2d0e959103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e95910a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024036:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788864777.024040:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+5:8434:x1875760546604288:12345-0@lo:104: Request processed in 37us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864777.024046:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788864777.024056:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788864777.024062:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+4:8434:x1875760546604416:12345-0@lo:104: 00010000:00010000:0.0:1788864777.024069:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ec00/0xf8c13e2d0e9590d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e9590e0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024093:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788864777.024098:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+4:8434:x1875760546604416:12345-0@lo:104: Request processed in 36us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864777.024103:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788864777.024114:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788864777.024119:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+3:8434:x1875760546604544:12345-0@lo:104: 00010000:00010000:0.0:1788864777.024132:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdc81497600/0xf8c13e2d0e9590af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e9590b6 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024158:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788864777.024162:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+3:8434:x1875760546604544:12345-0@lo:104: Request processed in 44us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864777.024169:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788864777.024187:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788864777.024193:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e95916c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024199:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdc80030400 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:0.0:1788864777.024203:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e95916c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024211:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e95916c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788864777.024218:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e95916c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864777.024223:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788864777.024249:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959165 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95916c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024255:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788864777.024273:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959165 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95916c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024279:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdc80030400/0xf8c13e2d0e959165 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95916c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024299:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788864777.024302:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15c00/0xf8c13e2d0e95913b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e959142 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024307:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca4d15c00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:0.0:1788864777.024310:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15c00/0xf8c13e2d0e95913b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e959142 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024317:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15c00/0xf8c13e2d0e95913b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e959142 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788864777.024323:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15c00/0xf8c13e2d0e95913b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e959142 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864777.024329:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788864777.024340:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15c00/0xf8c13e2d0e95913b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959142 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024345:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788864777.024350:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15c00/0xf8c13e2d0e95913b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959142 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024357:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15c00/0xf8c13e2d0e95913b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959142 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024366:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788864777.024369:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95911f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e959126 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024384:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213ea00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:0.0:1788864777.024387:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95911f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e959126 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024394:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95911f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e959126 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788864777.024400:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95911f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e959126 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864777.024404:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788864777.024414:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95911f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959126 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024419:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788864777.024432:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95911f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959126 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024439:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95911f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959126 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024447:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788864777.024451:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14200/0xf8c13e2d0e959111 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e959118 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024456:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca4d14200 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:0.0:1788864777.024459:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14200/0xf8c13e2d0e959111 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e959118 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024475:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14200/0xf8c13e2d0e959111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e959118 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788864777.024482:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14200/0xf8c13e2d0e959111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e959118 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864777.024487:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788864777.024499:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14200/0xf8c13e2d0e959111 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959118 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024504:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788864777.024510:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14200/0xf8c13e2d0e959111 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959118 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024517:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14200/0xf8c13e2d0e959111 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959118 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024525:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788864777.024528:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e600/0xf8c13e2d0e959103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e95910a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024534:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213e600 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:0.0:1788864777.024536:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e600/0xf8c13e2d0e959103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e95910a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024543:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e600/0xf8c13e2d0e959103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e95910a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788864777.024549:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e600/0xf8c13e2d0e959103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e95910a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864777.024560:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788864777.024572:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e600/0xf8c13e2d0e959103 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95910a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024578:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788864777.024582:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e600/0xf8c13e2d0e959103 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95910a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024588:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e600/0xf8c13e2d0e959103 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95910a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024596:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788864777.024598:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ec00/0xf8c13e2d0e9590d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e9590e0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024603:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213ec00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:0.0:1788864777.024606:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ec00/0xf8c13e2d0e9590d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e9590e0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024613:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ec00/0xf8c13e2d0e9590d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e9590e0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788864777.024620:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ec00/0xf8c13e2d0e9590d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e9590e0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864777.024625:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788864777.024636:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ec00/0xf8c13e2d0e9590d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e9590e0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024641:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788864777.024652:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ec00/0xf8c13e2d0e9590d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e9590e0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024658:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ec00/0xf8c13e2d0e9590d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e9590e0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024666:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864777.024669:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdc81497600/0xf8c13e2d0e9590af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e9590b6 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024675:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdc81497600 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:0.0:1788864777.024678:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdc81497600/0xf8c13e2d0e9590af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e9590b6 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024684:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdc81497600/0xf8c13e2d0e9590af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e9590b6 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788864777.024690:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdc81497600/0xf8c13e2d0e9590af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e9590b6 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864777.024695:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788864777.024726:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdc81497600/0xf8c13e2d0e9590af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e9590b6 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024732:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788864777.024736:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdc81497600/0xf8c13e2d0e9590af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e9590b6 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024742:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdc81497600/0xf8c13e2d0e9590af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e9590b6 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.024755:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864777.024762:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864777.024764:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864777.024772:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864777.024785:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546604672:0@lo:103: 00000100:00100000:0.0:1788864777.024832:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864777.024853:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546605184:0@lo:103: 00000100:00100000:0.0:1788864777.024885:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864777.024907:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788864777.024913:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546604800:0@lo:103: 00000100:00100000:0.0:1788864777.024934:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864777.024947:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546605312:0@lo:103: 00000100:00100000:0.0:1788864777.024964:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864777.024986:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546605056:0@lo:103: 00000100:00100000:0.0:1788864777.025006:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864777.025018:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788864777.025023:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546604928:0@lo:103: 00000100:00100000:0.0:1788864777.025041:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864777.025050:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546605440:0@lo:103: 00000100:00100000:0.0:1788864777.025070:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864777.025090:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546604672 00000100:00100000:0.0:1788864777.025095:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546604672 00010000:00010000:0.0:1788864777.025115:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdc80031200/0xf8c13e2d0e95916c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e959165 expref: 19 pid: 5830 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864777.025131:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546605184 00000100:00100000:0.0:1788864777.025134:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546605184 00010000:00010000:0.0:1788864777.025144:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdc80030000/0xf8c13e2d0e95910a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e959103 expref: 20 pid: 5827 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864777.025166:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546604800 00000100:00100000:0.0:1788864777.025169:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546604800 00010000:00010000:0.0:1788864777.025180:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdca4d14800/0xf8c13e2d0e959142 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95913b expref: 21 pid: 5827 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864777.025189:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546605312 00000100:00100000:0.0:1788864777.025192:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546605312 00010000:00010000:0.0:1788864777.025201:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdca4d14c00/0xf8c13e2d0e9590e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e9590d9 expref: 22 pid: 5827 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864777.025209:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546605056 00000100:00100000:0.0:1788864777.025211:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546605056 00010000:00010000:0.0:1788864777.025220:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdc80030800/0xf8c13e2d0e959118 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e959111 expref: 23 pid: 5828 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864777.025228:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546604928 00000100:00100000:0.0:1788864777.025230:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546604928 00010000:00010000:0.0:1788864777.025240:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdca4d14e00/0xf8c13e2d0e959126 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95911f expref: 24 pid: 5828 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864777.025249:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546605440 00000100:00100000:0.0:1788864777.025252:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546605440 00010000:00010000:0.0:1788864777.025260:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdc81497c00/0xf8c13e2d0e9590b6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e9590af expref: 25 pid: 5830 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864777.025270:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788864777.025276:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+25:3302:x1875760546604672:12345-0@lo:103: 00010000:00010000:0.0:1788864777.025330:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864777.025336:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdc80031200/0xf8c13e2d0e95916c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e959165 expref: 25 pid: 5830 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.025356:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdc80031200/0xf8c13e2d0e95916c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e959165 expref: 25 pid: 5830 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.025371:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864777.025402:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+25:3302:x1875760546604672:12345-0@lo:103: Request processed in 125us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864777.025409:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788864777.025424:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788864777.025429:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+24:3302:x1875760546605184:12345-0@lo:103: 00010000:00010000:0.0:1788864777.025437:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864777.025441:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdc80030000/0xf8c13e2d0e95910a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e959103 expref: 24 pid: 5827 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.025449:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdc80030000/0xf8c13e2d0e95910a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e959103 expref: 24 pid: 5827 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.025457:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864777.025477:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+24:3302:x1875760546605184:12345-0@lo:103: Request processed in 48us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864777.025483:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788864777.025493:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788864777.025499:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+23:3302:x1875760546604800:12345-0@lo:103: 00010000:00010000:0.0:1788864777.025506:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864777.025511:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdca4d14800/0xf8c13e2d0e959142 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95913b expref: 23 pid: 5827 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.025518:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdca4d14800/0xf8c13e2d0e959142 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e95913b expref: 23 pid: 5827 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.025533:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864777.025556:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+23:3302:x1875760546604800:12345-0@lo:103: Request processed in 58us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864777.025562:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788864777.025574:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788864777.025580:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+22:3302:x1875760546605312:12345-0@lo:103: 00010000:00010000:0.0:1788864777.025587:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864777.025592:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdca4d14c00/0xf8c13e2d0e9590e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e9590d9 expref: 22 pid: 5827 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.025600:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdca4d14c00/0xf8c13e2d0e9590e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e9590d9 expref: 22 pid: 5827 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.025609:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864777.025627:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+22:3302:x1875760546605312:12345-0@lo:103: Request processed in 48us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864777.025633:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788864777.025644:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788864777.025649:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+21:3301:x1875760546605056:12345-0@lo:103: 00010000:00010000:0.0:1788864777.025655:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864777.025659:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdc80030800/0xf8c13e2d0e959118 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e959111 expref: 21 pid: 5828 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.025667:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdc80030800/0xf8c13e2d0e959118 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e959111 expref: 21 pid: 5828 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.025675:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864777.025727:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+21:3301:x1875760546605056:12345-0@lo:103: Request processed in 77us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864777.025733:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788864777.025747:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788864777.025752:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+20:3301:x1875760546604928:12345-0@lo:103: 00010000:00010000:0.0:1788864777.025759:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864777.025763:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdca4d14e00/0xf8c13e2d0e959126 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95911f expref: 20 pid: 5828 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.025771:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdca4d14e00/0xf8c13e2d0e959126 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e95911f expref: 20 pid: 5828 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.025780:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864777.025799:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+20:3301:x1875760546604928:12345-0@lo:103: Request processed in 47us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864777.025819:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788864777.025830:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788864777.025836:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1e51850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3301:x1875760546605440:12345-0@lo:103: 00010000:00010000:0.0:1788864777.025843:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864777.025847:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdc81497c00/0xf8c13e2d0e9590b6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e9590af expref: 19 pid: 5830 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.025855:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdc81497c00/0xf8c13e2d0e9590b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e9590af expref: 19 pid: 5830 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.025864:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864777.025883:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1e51850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3301:x1875760546605440:12345-0@lo:103: Request processed in 48us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864777.025889:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788864777.025950:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546604928:0@lo:103: 00000100:00100000:0.0:1788864777.025958:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546605440:0@lo:103: 00000100:00100000:0.0:1788864777.025965:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546605056:0@lo:103: 00000100:00100000:0.0:1788864777.025992:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546604800:0@lo:103: 00000100:00100000:0.0:1788864777.025999:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546605312:0@lo:103: 00000100:00100000:0.0:1788864777.026006:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546604672:0@lo:103: 00000100:00100000:0.0:1788864777.026012:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546605184:0@lo:103: 00010000:00010000:3.0:1788864777.026112:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdc80031200/0xf8c13e2d0e95916c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e959165 expref: 18 pid: 5830 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864777.026123:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875760546603776:0@lo:104: 00010000:00010000:3.0:1788864777.026133:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdca4d14800/0xf8c13e2d0e959142 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e95913b expref: 17 pid: 5827 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864777.026141:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875760546603904:0@lo:104: 00010000:00010000:3.0:1788864777.026149:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdca4d14e00/0xf8c13e2d0e959126 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e95911f expref: 16 pid: 5828 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864777.026156:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875760546604032:0@lo:104: 00010000:00010000:3.0:1788864777.026165:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdc80030800/0xf8c13e2d0e959118 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e959111 expref: 15 pid: 5828 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864777.026173:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875760546604160:0@lo:104: 00010000:00010000:3.0:1788864777.026181:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdc80030000/0xf8c13e2d0e95910a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e959103 expref: 14 pid: 5827 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864777.026201:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875760546604288:0@lo:104: 00010000:00010000:3.0:1788864777.026212:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdca4d14c00/0xf8c13e2d0e9590e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e9590d9 expref: 13 pid: 5827 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864777.026220:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0638a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875760546604416:0@lo:104: 00010000:00010000:3.0:1788864777.026229:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdc81497c00/0xf8c13e2d0e9590b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e9590af expref: 12 pid: 5830 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864777.026237:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0639880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875760546604544:0@lo:104: 00000100:00100000:2.0:1788864777.032473:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864777.032509:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864777.032780:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528756736 00000100:00100000:1.0:1788864777.032790:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528756736 00010000:00010000:1.0:1788864777.032843:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdc80031000/0xf8c13e2d0e959181 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9c1 expref: 10 pid: 5830 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864777.032874:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528756864 00000100:00100000:1.0:1788864777.032877:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528756864 00010000:00010000:1.0:1788864777.032890:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdca4d14400/0xf8c13e2d0e95917a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9ba expref: 11 pid: 5828 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864777.032906:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1788864777.032915:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0360a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:202cc404-00bb-4314-9125-b9b0b45f494c+11:2359:x1875760528756736:12345-192.168.203.13@tcp:103: 00010000:00010000:1.0:1788864777.032944:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864777.032950:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdc80031000/0xf8c13e2d0e959181 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9c1 expref: 11 pid: 5830 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864777.032963:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdc80031000/0xf8c13e2d0e959181 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9c1 expref: 11 pid: 5830 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864777.032982:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864777.033034:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0360a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:202cc404-00bb-4314-9125-b9b0b45f494c+11:2359:x1875760528756736:12345-192.168.203.13@tcp:103: Request processed in 119us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864777.033041:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1788864777.033059:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:1.0:1788864777.033066:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0360380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:202cc404-00bb-4314-9125-b9b0b45f494c+10:2359:x1875760528756864:12345-192.168.203.13@tcp:103: 00010000:00010000:1.0:1788864777.033073:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864777.033077:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdca4d14400/0xf8c13e2d0e95917a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9ba expref: 10 pid: 5828 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864777.033086:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdca4d14400/0xf8c13e2d0e95917a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9ba expref: 10 pid: 5828 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864777.033098:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fdb8213f800/0xf8c13e2d0e9591b9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864777.033106:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdb8213f800/0xf8c13e2d0e9591b9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864777.033121:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fdb8213f800/0xf8c13e2d0e9591b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864777.033139:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fdb8213f800/0xf8c13e2d0e9591b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864777.033146:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fdb8213f800/0xf8c13e2d0e9591b9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864777.033152:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fdb8213f800/0xf8c13e2d0e9591b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864777.033158:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213f800 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788864777.033162:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fdb8213f800/0xf8c13e2d0e9591b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864777.033170:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fdb8213f800/0xf8c13e2d0e9591b9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864777.033179:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fdb8213f800/0xf8c13e2d0e9591b9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864777.033189:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864777.033208:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0360380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:202cc404-00bb-4314-9125-b9b0b45f494c+10:2359:x1875760528756864:12345-192.168.203.13@tcp:103: Request processed in 143us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864777.033215:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00010000:00010000:0.0:1788864777.033628:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdc80031000/0xf8c13e2d0e959181 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9c1 expref: 9 pid: 5830 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864777.033642:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875760546603520:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788864777.033654:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdca4d14400/0xf8c13e2d0e95917a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9ba expref: 8 pid: 5828 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864777.033663:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875760546603648:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788864777.033745:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fdb8213f800/0xf8c13e2d0e9591b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.033755:0:8434:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fdb8213f800/0xf8c13e2d0e9591b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.033762:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fdb8213f800/0xf8c13e2d0e9591b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.033768:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdb8213f800/0xf8c13e2d0e9591b9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864777.797003:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788864778.564766:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788864778.564773:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fdcbfd92000 from 39 10000000:01000000:1.0:1788864778.564787:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788864778.564898:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15a00/0xf8c13e2d0e9591c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864778.564910:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15a00/0xf8c13e2d0e9591c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864778.564936:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15a00/0xf8c13e2d0e9591c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864778.564961:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfe08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546605568:0@lo:101: 00000100:00100000:1.0:1788864778.565037:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864778.565093:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1e6e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788864778.565286:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546605568 00000100:00100000:0.0:1788864778.565294:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546605568 00000100:00100000:0.0:1788864778.565367:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788864778.565376:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+12:5832:x1875760546605568:12345-0@lo:101: 00010000:00010000:0.0:1788864778.565388:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864778.565401:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdc80031000/0xf8c13e2d0e9591c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e9591c0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864778.565423:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdc80031000/0xf8c13e2d0e9591c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e9591c0 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864778.565434:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdc80031000/0xf8c13e2d0e9591c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e9591c0 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864778.565442:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdc80031000, rc 0) 00000100:00100000:0.0:1788864778.565486:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:5832:x1875760546605568:12345-0@lo:101: Request processed in 112us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864778.565493:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788864778.565694:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfe08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546605568:0@lo:101: 00010000:00010000:1.0:1788864778.565731:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15a00/0xf8c13e2d0e9591c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9591c7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864778.565739:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15a00/0xf8c13e2d0e9591c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e9591c7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864778.566014:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfe08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546605696:0@lo:501: 00000100:00100000:1.0:1788864778.566044:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864778.567908:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1e6e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788864778.574265:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546605696 00000100:00100000:2.0:1788864778.574293:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546605696 00000100:00100000:2.0:1788864778.574383:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788864778.574395:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:5832:x1875760546605696:12345-0@lo:501: 00000100:00100000:2.0:1788864778.575271:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:5832:x1875760546605696:12345-0@lo:501: Request processed in 877us (9224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864778.575281:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788864778.575460:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfe08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546605696:0@lo:501: 00000100:00100000:1.0:1788864778.575510:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfe08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546605824:0@lo:503: 00000100:00100000:1.0:1788864778.575562:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864778.575599:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1e6e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788864778.576064:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546605824 00000100:00100000:2.0:1788864778.576070:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546605824 00000100:00100000:2.0:1788864778.576106:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788864778.576114:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:5832:x1875760546605824:12345-0@lo:503: 00000100:00100000:2.0:1788864778.576310:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:5832:x1875760546605824:12345-0@lo:503: Request processed in 195us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864778.576318:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788864778.576501:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfe08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546605824:0@lo:503: 00000100:00100000:1.0:1788864778.576980:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfe08380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8452:1875760546605952:0@lo:502: 00000100:00100000:1.0:1788864778.577022:0:8452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864778.577058:0:8452:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1e6e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788864778.577113:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546605952 00000100:00100000:3.0:1788864778.577119:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546605952 00000100:00100000:3.0:1788864778.577142:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788864778.577160:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:8452:x1875760546605952:12345-0@lo:502: 00000100:00100000:3.0:1788864778.577533:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:8452:x1875760546605952:12345-0@lo:502: Request processed in 374us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864778.577541:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788864778.577835:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfe08380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8452:1875760546605952:0@lo:502: 00000100:00100000:1.0:1788864778.577884:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfe08380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8452:1875760546606080:0@lo:502: 00000100:00100000:1.0:1788864778.577919:0:8452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864778.577948:0:8452:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcb5307000 going to sleep for 11 seconds 00000100:00100000:3.0:1788864778.578000:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546606080 00000100:00100000:3.0:1788864778.578005:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546606080 00000100:00100000:3.0:1788864778.578034:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788864778.578041:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:8452:x1875760546606080:12345-0@lo:502: 00000100:00100000:3.0:1788864778.578211:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:8452:x1875760546606080:12345-0@lo:502: Request processed in 170us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864778.578218:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788864778.578487:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfe08380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8452:1875760546606080:0@lo:502: 00000040:00080000:1.0:1788864778.578509:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788864778.583118:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788864778.583165:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788864778.583178:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15a00/0xf8c13e2d0e9591c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9591c7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864778.583208:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15a00/0xf8c13e2d0e9591c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9591c7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864778.583219:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788864778.583222:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788864778.583225:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788864778.583264:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f000/0xf8c13e2d0e9591ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864778.583271:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f000/0xf8c13e2d0e9591ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864778.583291:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f000/0xf8c13e2d0e9591ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864778.583321:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0638000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546606208:0@lo:101: 00000100:00100000:3.0:1788864778.583393:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864778.583438:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc87333a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788864778.583669:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546606208 00000100:00100000:0.0:1788864778.583677:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546606208 00000100:00100000:0.0:1788864778.583766:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788864778.583776:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+13:5832:x1875760546606208:12345-0@lo:101: 00010000:00010000:0.0:1788864778.583788:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864778.583810:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdc80031c00/0xf8c13e2d0e9591d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e9591ce expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864778.583832:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdc80031c00/0xf8c13e2d0e9591d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e9591ce expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864778.583852:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdc80031c00/0xf8c13e2d0e9591d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e9591ce expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864778.583860:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdc80031c00, rc 0) 00000100:00100000:0.0:1788864778.583906:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:5832:x1875760546606208:12345-0@lo:101: Request processed in 131us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864778.583912:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788864778.584033:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0638000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546606208:0@lo:101: 00010000:00010000:1.0:1788864778.584050:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f000/0xf8c13e2d0e9591ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9591d5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864778.584059:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f000/0xf8c13e2d0e9591ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e9591d5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864778.584109:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfe08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546606336:0@lo:501: 00000100:00100000:1.0:1788864778.584137:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864778.584168:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1e6e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788864778.584484:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546606336 00000100:00100000:0.0:1788864778.584489:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546606336 00000100:00100000:0.0:1788864778.584522:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788864778.584529:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:5832:x1875760546606336:12345-0@lo:501: 00000100:00100000:0.0:1788864778.584813:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:5832:x1875760546606336:12345-0@lo:501: Request processed in 284us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864778.584821:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788864778.584854:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfe08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546606336:0@lo:501: 00000100:00100000:0.0:1788864778.584883:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546606464:0@lo:503: 00000100:00100000:0.0:1788864778.584924:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864778.584938:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfdbecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864778.584948:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546606464 00000100:00100000:0.0:1788864778.584952:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546606464 00000100:00100000:0.0:1788864778.584968:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788864778.584973:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:5832:x1875760546606464:12345-0@lo:503: 00000100:00100000:0.0:1788864778.585106:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:5832:x1875760546606464:12345-0@lo:503: Request processed in 132us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864778.585114:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788864778.586887:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546606464:0@lo:503: 00000100:00100000:2.0:1788864778.600126:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0361880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8453:1875760546606592:0@lo:502: 00000100:00100000:0.0:1788864778.602358:0:8453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864778.602412:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcacbe0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788864778.602634:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546606592 00000100:00100000:2.0:1788864778.602643:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546606592 00000100:00100000:2.0:1788864778.602738:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788864778.602750:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:8453:x1875760546606592:12345-0@lo:502: 00000100:00100000:2.0:1788864778.602986:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:8453:x1875760546606592:12345-0@lo:502: Request processed in 238us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864778.602994:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788864778.604271:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0361880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8453:1875760546606592:0@lo:502: 00000020:01000000:0.0:1788864778.604323:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788864778.604346:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864778.604348:0:8453:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788864778.604354:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788864778.604389:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8453:1875760546606720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864778.604445:0:8453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864778.604482:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfdbecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788864778.604739:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546606720 00000100:00100000:3.0:1788864778.604746:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546606720 00000100:00100000:3.0:1788864778.604791:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788864778.604811:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:8453:x1875760546606720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788864778.605008:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:8453:x1875760546606720:12345-0@lo:502:llog_process_th.0 Request processed in 198us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864778.605015:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788864778.605408:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8453:1875760546606720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788864778.605431:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788864778.605436:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864778.605438:0:8453:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788864778.605442:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788864778.613521:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788864778.613560:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788864778.613571:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f000/0xf8c13e2d0e9591ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9591d5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864778.613584:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f000/0xf8c13e2d0e9591ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9591d5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788864778.613595:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788864778.613597:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fdcacbf0000 from 39 10000000:01000000:1.0:1788864778.613600:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788864778.613640:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e9591dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864778.613663:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e9591dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864778.613676:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e9591dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864778.613945:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546606848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788864778.614010:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864778.614075:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1e6e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788864778.614932:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546606848 00000100:00100000:0.0:1788864778.614941:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546606848 00000100:00100000:0.0:1788864778.614998:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788864778.615007:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:5832:x1875760546606848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788864778.615020:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864778.615037:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdc80030400/0xf8c13e2d0e9591e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e9591dc expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864778.615062:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdc80030400/0xf8c13e2d0e9591e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e9591dc expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864778.615072:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdc80030400/0xf8c13e2d0e9591e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e9591dc expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864778.615093:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdc80030400, rc 0) 00000100:00100000:1.0:1788864778.615239:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546606848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788864778.615257:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e9591dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9591e3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864778.615266:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e9591dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e9591e3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864778.620387:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546606976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788864778.622193:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864778.622231:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1e6e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788864778.622297:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546606976 00000100:00100000:2.0:1788864778.622306:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546606976 00000100:00100000:2.0:1788864778.622368:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788864778.622378:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:5832:x1875760546606976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788864778.622679:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:5832:x1875760546606976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864778.622697:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788864778.623154:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546606976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788864778.623205:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546607104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788864778.623252:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864778.623283:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1e6e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788864778.623548:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546607104 00000100:00100000:2.0:1788864778.623554:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546607104 00000100:00100000:2.0:1788864778.623587:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788864778.623595:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:5832:x1875760546607104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788864778.623805:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:5832:x1875760546607104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864778.623812:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788864778.623958:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546607104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788864778.624103:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:5832:x1875760546606848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 9096us (10091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864778.624111:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788864778.624488:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8454:1875760546607232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864778.624529:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864778.624560:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfdbe000 going to sleep for 11 seconds 00000100:00100000:2.0:1788864778.624666:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546607232 00000100:00100000:2.0:1788864778.624672:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546607232 00000100:00100000:2.0:1788864778.624728:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788864778.624735:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:8454:x1875760546607232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788864778.624928:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:8454:x1875760546607232:12345-0@lo:502:llog_process_th.0 Request processed in 192us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864778.624935:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788864778.625142:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8454:1875760546607232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864778.625198:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8454:1875760546607360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864778.625232:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864778.625251:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc9f517300 going to sleep for 11 seconds 00000100:00100000:1.0:1788864778.625358:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546607360 00000100:00100000:1.0:1788864778.625368:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546607360 00000100:00100000:1.0:1788864778.625401:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788864778.625408:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:8454:x1875760546607360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788864778.625558:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:8454:x1875760546607360:12345-0@lo:502:llog_process_th.0 Request processed in 150us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864778.625565:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788864778.625743:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8454:1875760546607360:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788864778.625780:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788864778.625952:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788864778.625974:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788864778.625984:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e9591dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9591e3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864778.626002:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e9591dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9591e3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864778.626013:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788864778.626016:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788864778.626019:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788864778.626046:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fa00/0xf8c13e2d0e9591ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864778.626054:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fa00/0xf8c13e2d0e9591ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864778.626063:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fa00/0xf8c13e2d0e9591ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864778.626078:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546607488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788864778.626109:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864778.626137:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc87333900 going to sleep for 11 seconds 00000100:00100000:0.0:1788864778.626312:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546607488 00000100:00100000:0.0:1788864778.626318:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546607488 00000100:00100000:0.0:1788864778.626363:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788864778.626370:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:5832:x1875760546607488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788864778.626379:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864778.626391:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdc80030000/0xf8c13e2d0e9591f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e9591ea expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864778.626411:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdc80030000/0xf8c13e2d0e9591f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e9591ea expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864778.626422:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdc80030000/0xf8c13e2d0e9591f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e9591ea expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864778.626436:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdc80030000, rc 0) 00000100:00100000:0.0:1788864778.626470:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:5832:x1875760546607488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864778.626476:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788864778.626652:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546607488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788864778.626668:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fa00/0xf8c13e2d0e9591ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9591f1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864778.626677:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fa00/0xf8c13e2d0e9591ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e9591f1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864778.626764:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546607616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788864778.626790:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864778.626824:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc87333900 going to sleep for 11 seconds 00000100:00100000:0.0:1788864778.626985:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546607616 00000100:00100000:0.0:1788864778.626990:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546607616 00000100:00100000:0.0:1788864778.627010:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788864778.627016:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:5832:x1875760546607616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788864778.627263:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:5832:x1875760546607616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864778.627270:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788864778.627519:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546607616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788864778.627552:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546607744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788864778.627590:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864778.627619:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc87333900 going to sleep for 11 seconds 00000100:00100000:2.0:1788864778.627937:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546607744 00000100:00100000:2.0:1788864778.627942:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546607744 00000100:00100000:2.0:1788864778.627981:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788864778.627989:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:5832:x1875760546607744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788864778.628278:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:5832:x1875760546607744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 290us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864778.628292:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788864778.629482:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546607744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788864778.633943:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8455:1875760546607872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864778.634026:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864778.634069:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc9f517900 going to sleep for 11 seconds 00000100:00100000:3.0:1788864778.634187:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546607872 00000100:00100000:3.0:1788864778.634194:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546607872 00000100:00100000:3.0:1788864778.634236:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788864778.634244:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:8455:x1875760546607872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788864778.634787:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8455:1875760546607872:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788864778.634825:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788864778.634834:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864778.634836:0:8455:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788864778.634841:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788864778.634862:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfe09f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8455:1875760546608000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788864778.634897:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864778.634916:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1e6e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788864778.634977:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:8455:x1875760546607872:12345-0@lo:502:llog_process_th.0 Request processed in 441us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864778.634985:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788864778.635016:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546608000 00000100:00100000:3.0:1788864778.635019:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546608000 00000100:00100000:3.0:1788864778.635034:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788864778.635039:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:8455:x1875760546608000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788864778.635141:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:8455:x1875760546608000:12345-0@lo:502:llog_process_th.0 Request processed in 101us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864778.635230:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfe09f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8455:1875760546608000:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788864778.635248:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788864778.635251:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864778.635253:0:8455:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788864778.635256:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000100:00100000:3.0:1788864778.635501:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000020:01000000:3.0:1788864778.635529:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788864778.635548:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788864778.635557:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fa00/0xf8c13e2d0e9591ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9591f1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864778.635568:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fa00/0xf8c13e2d0e9591ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9591f1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864778.635583:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788864778.635586:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fdc8878e000 from 39 10000000:01000000:3.0:1788864778.635588:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788864778.635609:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f200/0xf8c13e2d0e9591f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864778.635617:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f200/0xf8c13e2d0e9591f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864778.635626:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f200/0xf8c13e2d0e9591f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864778.635638:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546608128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788864778.635664:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864778.635902:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546608128 00000100:00100000:2.0:1788864778.635907:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546608128 00000100:00100000:2.0:1788864778.635929:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788864778.635936:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:5832:x1875760546608128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788864778.635944:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864778.635956:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcc2045a00/0xf8c13e2d0e9591ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e9591f8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864778.635977:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcc2045a00/0xf8c13e2d0e9591ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e9591f8 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864778.635988:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcc2045a00/0xf8c13e2d0e9591ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e9591f8 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864778.635996:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcc2045a00, rc 0) 00000100:00100000:2.0:1788864778.636023:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546608128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864778.636029:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788864778.636256:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc87333840 going to sleep for 11 seconds 00000100:00100000:3.0:1788864778.636273:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546608128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788864778.636845:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f200/0xf8c13e2d0e9591f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9591ff expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864778.636856:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f200/0xf8c13e2d0e9591f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e9591ff expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864778.636912:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546608256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788864778.636944:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864778.636965:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc87333840 going to sleep for 11 seconds 00000100:00100000:2.0:1788864778.637029:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546608256 00000100:00100000:2.0:1788864778.637034:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546608256 00000100:00100000:2.0:1788864778.637069:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788864778.637077:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546608256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788864778.637636:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546608256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 558us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864778.637645:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788864778.638567:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546608256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788864778.638615:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546608384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788864778.638675:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864778.639911:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc87333840 going to sleep for 11 seconds 00000100:00100000:0.0:1788864778.656897:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546608384 00000100:00100000:0.0:1788864778.656912:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546608384 00000100:00100000:0.0:1788864778.656970:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788864778.656981:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546608384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788864778.657247:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546608384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 267us (18569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864778.657255:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788864778.657511:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546608384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788864778.661638:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0360000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8456:1875760546608512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788864778.661753:0:8456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864778.661803:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcacbe0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788864778.661865:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546608512 00000100:00100000:3.0:1788864778.661874:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546608512 00000100:00100000:3.0:1788864778.661920:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788864778.661930:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:8456:x1875760546608512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788864778.662186:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:8456:x1875760546608512:12345-0@lo:502:llog_process_th.0 Request processed in 257us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864778.662194:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788864778.662341:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0360000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8456:1875760546608512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788864778.662388:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0360000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8456:1875760546608640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788864778.662422:0:8456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864778.662452:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcacbe0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788864778.662692:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546608640 00000100:00100000:0.0:1788864778.662697:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546608640 00000100:00100000:0.0:1788864778.662746:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788864778.662753:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:8456:x1875760546608640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864778.662917:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:8456:x1875760546608640:12345-0@lo:502:llog_process_th.0 Request processed in 164us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864778.662924:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788864778.663026:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0360000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8456:1875760546608640:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788864778.663046:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788864778.663541:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788864778.663561:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788864778.663571:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f200/0xf8c13e2d0e9591f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9591ff expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864778.663582:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f200/0xf8c13e2d0e9591f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9591ff expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864778.663592:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788864778.663594:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788864778.663597:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788864778.663623:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e000/0xf8c13e2d0e959206 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864778.663631:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e000/0xf8c13e2d0e959206 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864778.663640:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e000/0xf8c13e2d0e959206 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864778.663664:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546608768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788864778.663741:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864778.663766:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc87333300 going to sleep for 11 seconds 00000100:00100000:0.0:1788864778.663921:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546608768 00000100:00100000:0.0:1788864778.663927:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546608768 00000100:00100000:0.0:1788864778.663958:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788864778.663966:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546608768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788864778.663975:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864778.663988:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdc80030800/0xf8c13e2d0e95920d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e959206 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864778.664010:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdc80030800/0xf8c13e2d0e95920d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e959206 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864778.664021:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdc80030800/0xf8c13e2d0e95920d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e959206 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864778.664029:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdc80030800, rc 0) 00000100:00100000:0.0:1788864778.664062:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546608768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864778.664068:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788864778.664322:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546608768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788864778.664348:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e000/0xf8c13e2d0e959206 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95920d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864778.664358:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e000/0xf8c13e2d0e959206 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95920d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864778.664406:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546608896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788864778.664433:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864778.664461:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc87333300 going to sleep for 11 seconds 00000100:00100000:2.0:1788864778.664510:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546608896 00000100:00100000:2.0:1788864778.664515:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546608896 00000100:00100000:2.0:1788864778.664546:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788864778.664553:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546608896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788864778.664850:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546608896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864778.664858:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788864778.666771:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546608896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788864778.666842:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546609024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788864778.666910:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864778.666947:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc87333300 going to sleep for 11 seconds 00000100:00100000:2.0:1788864778.667024:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546609024 00000100:00100000:2.0:1788864778.667031:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546609024 00000100:00100000:2.0:1788864778.667072:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788864778.667080:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546609024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788864778.667275:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546609024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864778.667290:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788864778.667500:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546609024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788864778.667694:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8457:1875760546609152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864778.667754:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864778.667777:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546609152 00000100:00100000:0.0:1788864778.667781:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546609152 00000100:00100000:0.0:1788864778.667816:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788864778.667830:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:8457:x1875760546609152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864778.667983:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:8457:x1875760546609152:12345-0@lo:502:llog_process_th.0 Request processed in 155us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864778.667990:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788864778.668024:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc9f517cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864778.668037:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8457:1875760546609152:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788864778.668059:0:8457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788864778.668068:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864778.668070:0:8457:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788864778.668075:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788864778.668094:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8457:1875760546609280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864778.668125:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864778.668210:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546609280 00000100:00100000:0.0:1788864778.668215:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546609280 00000100:00100000:0.0:1788864778.668234:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788864778.668239:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:8457:x1875760546609280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864778.668358:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:8457:x1875760546609280:12345-0@lo:502:llog_process_th.0 Request processed in 118us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864778.668365:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788864778.668391:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc9f517cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864778.668403:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8457:1875760546609280:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788864778.668420:0:8457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788864778.668423:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864778.668425:0:8457:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788864778.668428:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788864778.668482:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788864778.668499:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788864778.668513:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e000/0xf8c13e2d0e959206 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95920d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864778.668523:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e000/0xf8c13e2d0e959206 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95920d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864778.668533:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788864778.668535:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fdca1ff4d40 from 1 10000000:01000000:0.0:1788864778.668538:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788864778.668559:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdc80031200/0xf8c13e2d0e959214 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864778.668567:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdc80031200/0xf8c13e2d0e959214 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864778.668576:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdc80031200/0xf8c13e2d0e959214 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864778.668590:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546609408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788864778.668615:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864778.668629:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfdbe000 going to sleep for 11 seconds 00000100:00100000:0.0:1788864778.668641:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546609408 00000100:00100000:0.0:1788864778.668645:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546609408 00000100:00100000:0.0:1788864778.668662:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788864778.668667:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546609408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788864778.668676:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864778.668686:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdc80030a00/0xf8c13e2d0e95921b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e959214 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864778.668727:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdc80030a00/0xf8c13e2d0e95921b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e959214 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864778.668746:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdc80030a00/0xf8c13e2d0e95921b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e959214 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864778.668755:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdc80030a00, rc 0) 00000100:00100000:0.0:1788864778.668784:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:5832:x1875760546609408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864778.668790:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788864778.668829:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546609408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788864778.668840:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdc80031200/0xf8c13e2d0e959214 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95921b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864778.668849:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdc80031200/0xf8c13e2d0e959214 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95921b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864778.668883:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546609536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788864778.668906:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864778.668936:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc9f517900 going to sleep for 11 seconds 00000100:00100000:0.0:1788864778.668947:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546609536 00000100:00100000:0.0:1788864778.668950:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546609536 00000100:00100000:0.0:1788864778.668967:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788864778.668973:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:5832:x1875760546609536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788864778.672494:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:5832:x1875760546609536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3514us (3580us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788864778.672509:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788864778.678046:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546609536:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788864778.678108:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788864778.678135:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdc80031200/0xf8c13e2d0e959214 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95921b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864778.678288:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdc80031200/0xf8c13e2d0e959214 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95921b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864778.824601:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864779.162377:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864779.162435:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864779.162534:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528756992 00000100:00100000:3.0:1788864779.162544:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528756992 00000100:00100000:3.0:1788864779.162629:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 161 00000100:00100000:3.0:1788864779.162641:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+8:2357:x1875760528756992:12345-192.168.203.13@tcp:400: 00000100:00100000:3.0:1788864779.162734:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+8:2357:x1875760528756992:12345-192.168.203.13@tcp:400: Request processed in 95us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864779.162742:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 161 00000100:00100000:2.0:1788864779.163949:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864779.163980:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864779.164017:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528757376 00000100:00100000:1.0:1788864779.164026:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528757376 00000100:00100000:1.0:1788864779.164137:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528757248 00000100:00100000:1.0:1788864779.164142:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528757248 00000100:00100000:3.0:1788864779.164155:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00080000:2.0:1788864779.164174:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788864779.164180:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788864779.164185:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2356:x1875760528757376:12345-192.168.203.13@tcp:400: 00000100:00100000:3.0:1788864779.164261:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2356:x1875760528757376:12345-192.168.203.13@tcp:400: Request processed in 95us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864779.164269:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:1.0:1788864779.164315:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:1.0:1788864779.164325:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2356:x1875760528757248:12345-192.168.203.13@tcp:400: 00000100:00100000:1.0:1788864779.164358:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2356:x1875760528757248:12345-192.168.203.13@tcp:400: Request processed in 36us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864779.164377:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1788864779.165429:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528757120 00000100:00100000:0.0:1788864779.165445:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528757120 00000100:00100000:0.0:1788864779.165550:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:0.0:1788864779.165558:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2357:x1875760528757120:12345-192.168.203.13@tcp:400: 00000100:00100000:0.0:1788864779.165610:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2357:x1875760528757120:12345-192.168.203.13@tcp:400: Request processed in 52us (3174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864779.165617:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00080000:3.0:1788864779.170864:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788864779.589114:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546609664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788864779.589191:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864779.589378:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546609664 00000100:00100000:1.0:1788864779.589389:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546609664 00000100:00100000:1.0:1788864779.589457:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788864779.589466:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0362680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546609664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788864779.589498:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788864779.590893:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788864779.596524:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0362680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546609664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7050us (7326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864779.596538:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788864779.597955:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcac9f1500 x1875760546609664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864779.597981:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546609664:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788864779.845426:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864780.612978:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0360e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546610176:0@lo:400:kworker.0 00000100:00100000:2.0:1788864780.613046:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864780.613085:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546610176 00000100:00100000:2.0:1788864780.613092:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546610176 00000100:00100000:2.0:1788864780.613139:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788864780.613149:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0363100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546610176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864780.613196:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0363100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546610176:12345-0@lo:400:kworker.0 Request processed in 48us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864780.613203:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788864780.613265:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcc0360e00 x1875760546610176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864780.613729:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546610048:0@lo:400:kworker.0 00000100:00100000:3.0:1788864780.613766:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864780.613831:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546610048 00000100:00100000:3.0:1788864780.613836:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546610048 00000100:00100000:3.0:1788864780.613875:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788864780.613882:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc063b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546610048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864780.613921:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc063b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546610048:12345-0@lo:400:kworker.0 Request processed in 39us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864780.613928:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788864780.613973:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546610048:0@lo:400:kworker.0 00000100:00080000:3.0:1788864780.613994:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788864780.614762:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875760546609920:0@lo:400:kworker.0 00000100:00100000:1.0:1788864780.614813:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864780.614845:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0361180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546610432:0@lo:400:kworker.0 00000100:00100000:1.0:1788864780.614867:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864780.614893:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788864780.614899:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0362300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546609792:0@lo:400:kworker.0 00000100:00100000:1.0:1788864780.614923:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864780.614951:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875760546610304:0@lo:400:kworker.0 00000100:00100000:1.0:1788864780.614970:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864780.614996:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546609920 00000100:00100000:1.0:1788864780.615001:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546609920 00000100:00100000:1.0:1788864780.615025:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546610304 00000100:00100000:1.0:1788864780.615028:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546610304 00000100:00100000:1.0:1788864780.615046:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788864780.615052:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875760546609920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864780.615086:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875760546609920:12345-0@lo:400:kworker.0 Request processed in 34us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864780.615115:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788864780.615129:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788864780.615135:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875760546610304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864780.615160:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875760546610304:12345-0@lo:400:kworker.0 Request processed in 26us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864780.615165:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788864780.615191:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875760546610304:0@lo:400:kworker.0 00000100:00100000:1.0:1788864780.615199:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875760546609920:0@lo:400:kworker.0 00000100:00100000:1.0:1788864780.615219:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546610432 00000100:00100000:1.0:1788864780.615222:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546610432 00000100:00100000:1.0:1788864780.615248:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788864780.615254:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546610432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864780.615699:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0360e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546610176:0@lo:400:kworker.0 00010000:00080000:2.0:1788864780.615779:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcc0361180 x1875760546610432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864780.615802:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0361180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546610432:0@lo:400:kworker.0 00000100:00080000:3.0:1788864780.615959:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788864780.615964:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788864780.616071:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546610432:12345-0@lo:400:kworker.0 Request processed in 816us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864780.616079:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788864780.616189:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546609792 00000100:00100000:0.0:1788864780.616195:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546609792 00000100:00100000:0.0:1788864780.616229:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788864780.616237:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3303:x1875760546609792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864780.616754:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3303:x1875760546609792:12345-0@lo:400:kworker.0 Request processed in 518us (1829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864780.616762:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788864780.617039:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0362300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546609792:0@lo:400:kworker.0 00010000:00010000:0.0:1788864780.869329:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864781.124954:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788864781.124976:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfe08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546610560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788864781.125041:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864781.125296:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546610560 00000100:00100000:0.0:1788864781.125316:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546610560 00000100:00100000:0.0:1788864781.125368:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788864781.125378:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0362300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546610560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788864781.125413:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788864781.125467:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0362300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546610560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864781.125475:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788864781.125592:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcbfe08380 x1875760546610560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864781.125611:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfe08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546610560:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788864781.893073:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864782.916978:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864783.941444:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864784.273683:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864784.273799:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864784.273845:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864784.273867:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864784.273961:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528757632 00000100:00100000:3.0:1788864784.273972:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528757632 00000100:00100000:3.0:1788864784.274037:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:3.0:1788864784.274047:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2358:x1875760528757632:12345-192.168.203.13@tcp:400: 00000100:00100000:3.0:1788864784.274115:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2358:x1875760528757632:12345-192.168.203.13@tcp:400: Request processed in 70us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864784.274123:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:3.0:1788864784.274154:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528757504 00000100:00100000:3.0:1788864784.274158:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528757504 00000100:00100000:3.0:1788864784.274183:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 163 00000100:00100000:3.0:1788864784.274189:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+8:2358:x1875760528757504:12345-192.168.203.13@tcp:400: 00000100:00100000:3.0:1788864784.274215:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+8:2358:x1875760528757504:12345-192.168.203.13@tcp:400: Request processed in 26us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864784.274221:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 163 00000100:00100000:3.0:1788864784.274247:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528757888 00000100:00100000:3.0:1788864784.274250:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528757888 00000100:00100000:3.0:1788864784.274284:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528757760 00000100:00100000:3.0:1788864784.274287:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528757760 00000100:00100000:3.0:1788864784.274304:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:3.0:1788864784.274311:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2358:x1875760528757888:12345-192.168.203.13@tcp:400: 00000100:00100000:3.0:1788864784.274337:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2358:x1875760528757888:12345-192.168.203.13@tcp:400: Request processed in 27us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864784.274343:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:3.0:1788864784.274355:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:3.0:1788864784.274361:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2358:x1875760528757760:12345-192.168.203.13@tcp:400: 00000100:00100000:3.0:1788864784.274384:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2358:x1875760528757760:12345-192.168.203.13@tcp:400: Request processed in 24us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864784.274389:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00080000:1.0:1788864784.274902:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788864784.274917:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788864784.274920:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864784.709175:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788864784.709201:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546610688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788864784.709277:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864784.709464:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546610688 00000100:00100000:0.0:1788864784.709487:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546610688 00000100:00100000:0.0:1788864784.709556:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788864784.709567:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0638380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546610688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788864784.709601:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788864784.709659:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0638380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546610688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864784.709668:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788864784.709701:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcac9f0700 x1875760546610688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864784.709745:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546610688:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788864784.709791:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788864784.785536:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864784.785726:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528758016 00000100:00100000:1.0:1788864784.785737:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528758016 00000100:00100000:1.0:1788864784.785809:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 164 00000100:00100000:1.0:1788864784.785832:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+8:5597:x1875760528758016:12345-192.168.203.13@tcp:101: 00010000:00010000:1.0:1788864784.785848:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864784.785865:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdca4d14c00/0xf8c13e2d0e959222 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fa23 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864784.785894:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdca4d14c00/0xf8c13e2d0e959222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa23 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864784.785906:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdca4d14c00/0xf8c13e2d0e959222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa23 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864784.785916:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca4d14c00, rc 0) 00000100:00100000:1.0:1788864784.785978:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+9:5597:x1875760528758016:12345-192.168.203.13@tcp:101: Request processed in 148us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864784.785986:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 164 00000100:00100000:3.0:1788864784.789196:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864784.789297:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528758144 00000100:00100000:0.0:1788864784.789306:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528758144 00000100:00100000:0.0:1788864784.789359:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 165 00000100:00100000:0.0:1788864784.789369:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+9:5597:x1875760528758144:12345-192.168.203.13@tcp:501: 00000100:00100000:0.0:1788864784.789670:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+9:5597:x1875760528758144:12345-192.168.203.13@tcp:501: Request processed in 302us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864784.789678:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 165 00000100:00100000:2.0:1788864784.805341:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864784.805494:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528758272 00000100:00100000:3.0:1788864784.805517:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528758272 00000100:00100000:3.0:1788864784.805572:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 166 00000100:00100000:3.0:1788864784.805582:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+9:5597:x1875760528758272:12345-192.168.203.13@tcp:503: 00000100:00100000:3.0:1788864784.805844:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+9:5597:x1875760528758272:12345-192.168.203.13@tcp:503: Request processed in 262us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864784.805852:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 166 00000100:00100000:2.0:1788864784.847574:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864784.847667:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528758400 00000100:00100000:1.0:1788864784.847677:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528758400 00000100:00100000:1.0:1788864784.847772:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 167 00000100:00100000:1.0:1788864784.847783:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+9:6104:x1875760528758400:12345-192.168.203.13@tcp:502: 00000100:00100000:1.0:1788864784.848082:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+9:6104:x1875760528758400:12345-192.168.203.13@tcp:502: Request processed in 292us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864784.848091:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 167 00000100:00100000:1.0:1788864784.855285:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864784.855388:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528758528 00000100:00100000:0.0:1788864784.855399:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528758528 00000100:00100000:0.0:1788864784.855455:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 168 00000100:00100000:0.0:1788864784.855464:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+9:6104:x1875760528758528:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788864784.855782:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+9:6104:x1875760528758528:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 318us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864784.855790:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 168 00000100:00100000:2.0:1788864784.860919:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864784.861166:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528758656 00000100:00100000:3.0:1788864784.861176:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528758656 00000100:00100000:3.0:1788864784.861235:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 169 00000100:00100000:3.0:1788864784.861246:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+9:5597:x1875760528758656:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788864784.861272:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864784.861291:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdb8213ee00/0xf8c13e2d0e959229 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fa2a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864784.861318:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdb8213ee00/0xf8c13e2d0e959229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa2a expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864784.861330:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdb8213ee00/0xf8c13e2d0e959229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa2a expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864784.861338:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213ee00, rc 0) 00000100:00100000:3.0:1788864784.861392:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+10:5597:x1875760528758656:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 148us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864784.861399:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 169 00000100:00100000:2.0:1788864784.869924:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864784.870017:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528758784 00000100:00100000:1.0:1788864784.870027:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528758784 00000100:00100000:1.0:1788864784.870086:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 170 00000100:00100000:1.0:1788864784.870096:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+10:5597:x1875760528758784:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788864784.870474:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+10:5597:x1875760528758784:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 378us (558us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788864784.870483:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 170 00010000:00010000:0.0:1788864784.968154:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864785.732994:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546611200:0@lo:400:kworker.0 00000100:00100000:0.0:1788864785.733043:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0361180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546610816:0@lo:400:kworker.0 00000100:00100000:1.0:1788864785.733126:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0360e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875760546610944:0@lo:400:kworker.0 00000100:00100000:3.0:1788864785.733196:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546611072:0@lo:400:kworker.0 00000100:00100000:2.0:1788864785.736776:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864785.736845:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546611200 00000100:00100000:2.0:1788864785.736855:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546611200 00000100:00100000:2.0:1788864785.736942:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788864785.736953:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546611200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864785.737028:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546611200:12345-0@lo:400:kworker.0 Request processed in 77us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864785.737035:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788864785.738277:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcc0361880 x1875760546611200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864785.738309:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546611200:0@lo:400:kworker.0 00000100:00100000:0.0:1788864785.739561:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864785.739612:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875760546611328:0@lo:400:kworker.0 00000100:00100000:0.0:1788864785.739668:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864785.739718:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546611328 00000100:00100000:0.0:1788864785.739725:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546611328 00000100:00100000:0.0:1788864785.739801:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788864785.739810:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875760546611328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864785.739858:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875760546611328:12345-0@lo:400:kworker.0 Request processed in 48us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864785.739865:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788864785.739905:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875760546611328:0@lo:400:kworker.0 00000100:00080000:0.0:1788864785.739942:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788864785.740200:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546610816 00000100:00100000:2.0:1788864785.740206:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546610816 00000100:00100000:2.0:1788864785.740248:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788864785.740256:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3302:x1875760546610816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864785.740316:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3302:x1875760546610816:12345-0@lo:400:kworker.0 Request processed in 61us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864785.740330:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788864785.740896:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0361180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546610816:0@lo:400:kworker.0 00000100:00100000:1.0:1788864785.750220:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864785.750295:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546611456:0@lo:400:kworker.0 00000100:00100000:2.0:1788864785.750441:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546610944 00000100:00100000:2.0:1788864785.750450:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546610944 00000100:00100000:2.0:1788864785.750499:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788864785.750508:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875760546610944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864785.750565:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875760546610944:12345-0@lo:400:kworker.0 Request processed in 58us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864785.750572:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788864785.750789:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864785.750851:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546611072 00000100:00100000:2.0:1788864785.750856:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546611072 00000100:00100000:2.0:1788864785.750897:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788864785.750904:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc063ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546611072:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788864785.750906:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788864785.750962:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc063ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546611072:12345-0@lo:400:kworker.0 Request processed in 59us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864785.750969:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788864785.751002:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546611072:0@lo:400:kworker.0 00000100:00100000:1.0:1788864785.751058:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864785.751100:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0360e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875760546610944:0@lo:400:kworker.0 00000100:00100000:2.0:1788864785.751221:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546611456 00000100:00100000:2.0:1788864785.751226:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546611456 00000100:00100000:2.0:1788864785.751284:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788864785.751291:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546611456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864785.751332:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546611456:12345-0@lo:400:kworker.0 Request processed in 33us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864785.751339:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788864785.752308:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc9f45ed80 x1875760546611456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864785.752482:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546611456:0@lo:400:kworker.0 00000100:00080000:3.0:1788864785.752560:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788864785.990499:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864786.245800:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbff00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546611584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788864786.245879:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864786.246008:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546611584 00000100:00100000:1.0:1788864786.246018:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546611584 00000100:00100000:1.0:1788864786.246075:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788864786.246085:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546611584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788864786.246119:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788864786.246167:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546611584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864786.246174:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788864786.246480:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcbff00700 x1875760546611584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864786.246500:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbff00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546611584:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1788864786.506672:0:8496:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe6625d180 20000000:00000080:2.0:1788864786.506689:0:8496:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fdcc0657c00 uarg=0000000000000000 20000000:01000000:2.0:1788864786.507654:0:8496:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788864786.507661:0:8496:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788864786.507665:0:8496:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788864786.509333:0:8497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788864786.511973:0:8496:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788864786.529613:0:8496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788864786.529675:0:8496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788864786.529774:0:8496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788864786.529796:0:8496:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788864786.529816:0:8496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e959230 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864786.529852:0:8496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdc81497400/0xf8c13e2d0e958ff9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e958ff2 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864786.529860:0:8496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959077 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e959070 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864786.529866:0:8496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdc81496800/0xf8c13e2d0e9590d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e9590cb expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864786.529875:0:8496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e95918f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9f2 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864786.529883:0:8496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e959230 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864786.529919:0:8496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e95918f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9f2 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864786.529934:0:8496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e95918f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9f2 expref: 9 pid: 5830 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864786.529950:0:8496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1875760546611712:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788864786.530055:0:8496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdc81496800/0xf8c13e2d0e9590d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e9590cb expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864786.530063:0:8496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fdc81496800/0xf8c13e2d0e9590d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e9590cb expref: 18 pid: 5827 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864786.530071:0:8496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1875760546611840:0@lo:104: 00000100:00100000:2.0:1788864786.530117:0:8496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788864786.530148:0:8496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e959070 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864786.530156:0:8496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959077 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e959070 expref: 18 pid: 5830 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864786.530164:0:8496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1875760546611968:0@lo:104: 00000100:00100000:2.0:1788864786.530186:0:8496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788864786.530205:0:8496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdc81497400/0xf8c13e2d0e958ff9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e958ff2 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864786.530212:0:8496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fdc81497400/0xf8c13e2d0e958ff9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e958ff2 expref: 18 pid: 5830 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864786.530220:0:8496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1875760546612096:0@lo:104: 00000100:00100000:2.0:1788864786.530238:0:8496:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca0d35180 going to sleep for 11 seconds 00000100:00100000:0.0:1788864786.535004:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788864786.535055:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864786.535080:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546611840 00000100:00100000:0.0:1788864786.535087:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546611840 00000100:00100000:0.0:1788864786.535127:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546611968 00000100:00100000:0.0:1788864786.535130:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546611968 00000100:00100000:0.0:1788864786.535140:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546612096 00000100:00100000:0.0:1788864786.535142:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546612096 00000100:00100000:0.0:1788864786.535155:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788864786.535163:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+5:8496:x1875760546611840:12345-0@lo:104: 00010000:00010000:0.0:1788864786.535181:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdc81496600/0xf8c13e2d0e9590cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e9590d2 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.535252:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788864786.535259:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+5:8496:x1875760546611840:12345-0@lo:104: Request processed in 97us (5143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864786.535282:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788864786.535300:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788864786.535306:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+4:8496:x1875760546611968:12345-0@lo:104: 00010000:00010000:0.0:1788864786.535314:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044400/0xf8c13e2d0e959070 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e959077 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.535350:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788864786.535355:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+4:8496:x1875760546611968:12345-0@lo:104: Request processed in 50us (5168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864786.535361:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788864786.535392:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788864786.535398:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+3:8496:x1875760546612096:12345-0@lo:104: 00010000:00010000:0.0:1788864786.535405:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14600/0xf8c13e2d0e958ff2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e958ff9 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.535431:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788864786.535435:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+3:8496:x1875760546612096:12345-0@lo:104: Request processed in 39us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864786.535440:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788864786.535456:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788864786.535461:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdc81496600/0xf8c13e2d0e9590cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e9590d2 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.535467:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdc81496600 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:0.0:1788864786.535471:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdc81496600/0xf8c13e2d0e9590cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e9590d2 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.535490:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdc81496600/0xf8c13e2d0e9590cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e9590d2 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788864786.535497:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdc81496600/0xf8c13e2d0e9590cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e9590d2 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864786.535503:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788864786.535534:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdc81496600/0xf8c13e2d0e9590cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e9590d2 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.535542:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788864786.535564:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdc81496600/0xf8c13e2d0e9590cb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e9590d2 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.535572:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdc81496600/0xf8c13e2d0e9590cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e9590d2 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.535583:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788864786.535587:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044400/0xf8c13e2d0e959070 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e959077 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.535591:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc2044400 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:0.0:1788864786.535594:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044400/0xf8c13e2d0e959070 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e959077 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.535600:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044400/0xf8c13e2d0e959070 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e959077 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788864786.535607:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044400/0xf8c13e2d0e959070 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e959077 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864786.535619:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788864786.535633:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044400/0xf8c13e2d0e959070 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959077 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.535639:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788864786.535653:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044400/0xf8c13e2d0e959070 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959077 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.535660:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044400/0xf8c13e2d0e959070 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959077 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.535669:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864786.535672:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14600/0xf8c13e2d0e958ff2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e958ff9 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.535677:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca4d14600 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:0.0:1788864786.535680:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14600/0xf8c13e2d0e958ff2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e958ff9 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.535687:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14600/0xf8c13e2d0e958ff2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e958ff9 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788864786.535693:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14600/0xf8c13e2d0e958ff2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e958ff9 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864786.535697:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788864786.535730:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14600/0xf8c13e2d0e958ff2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e958ff9 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.535736:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788864786.535761:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14600/0xf8c13e2d0e958ff2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e958ff9 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.535768:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14600/0xf8c13e2d0e958ff2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e958ff9 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.535783:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864786.535784:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864786.535786:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864786.535793:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864786.535935:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546612224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788864786.535971:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864786.536018:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546612352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788864786.536038:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864786.536075:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788864786.536081:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546612480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788864786.536101:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864786.536127:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546612224 00000100:00100000:0.0:1788864786.536131:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546612224 00010000:00010000:0.0:1788864786.536151:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdc81496800/0xf8c13e2d0e9590d2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e9590cb expref: 19 pid: 5827 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864786.536166:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546612352 00000100:00100000:0.0:1788864786.536168:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546612352 00010000:00010000:0.0:1788864786.536178:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959077 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e959070 expref: 20 pid: 5830 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864786.536187:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546612480 00000100:00100000:0.0:1788864786.536190:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546612480 00010000:00010000:0.0:1788864786.536198:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdc81497400/0xf8c13e2d0e958ff9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e958ff2 expref: 21 pid: 5830 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864786.536219:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788864786.536224:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+21:3301:x1875760546612224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788864786.536235:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864786.536241:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdc81496800/0xf8c13e2d0e9590d2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e9590cb expref: 21 pid: 5827 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.536250:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdc81496800/0xf8c13e2d0e9590d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e9590cb expref: 21 pid: 5827 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.536266:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864786.536306:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+21:3301:x1875760546612224:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864786.536313:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788864786.536327:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788864786.536333:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+20:3302:x1875760546612352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788864786.536340:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864786.536344:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959077 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e959070 expref: 20 pid: 5830 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.536352:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959077 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e959070 expref: 20 pid: 5830 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.536360:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864786.536386:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+20:3302:x1875760546612352:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864786.536392:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788864786.536407:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788864786.536420:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3302:x1875760546612480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788864786.536427:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864786.536432:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdc81497400/0xf8c13e2d0e958ff9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e958ff2 expref: 19 pid: 5830 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.536439:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdc81497400/0xf8c13e2d0e958ff9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e958ff2 expref: 19 pid: 5830 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.536448:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864786.536469:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3302:x1875760546612480:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864786.536475:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788864786.536525:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546612480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788864786.536534:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546612352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788864786.536598:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546612224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788864786.542891:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864786.542923:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528758912 00000100:00100000:0.0:1788864786.542933:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528758912 00010000:00010000:0.0:1788864786.542973:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e95918f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9f2 expref: 10 pid: 5830 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864786.543006:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:0.0:1788864786.543016:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:202cc404-00bb-4314-9125-b9b0b45f494c+10:2359:x1875760528758912:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788864786.543031:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864786.543037:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e95918f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9f2 expref: 10 pid: 5830 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.543050:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e95918f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9f2 expref: 10 pid: 5830 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.543083:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e959230 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.543091:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e959230 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.543107:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e959230 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.543114:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e959230 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.543122:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e959230 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.543128:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e959230 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.543135:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc2044600 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788864786.543140:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e959230 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.543148:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e959230 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.543156:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e959230 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864786.543166:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864786.543226:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:202cc404-00bb-4314-9125-b9b0b45f494c+10:2359:x1875760528758912:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 211us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864786.543245:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00010000:00010000:3.0:1788864786.543807:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e95918f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9f2 expref: 9 pid: 5830 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864786.543825:0:8496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1875760546611712:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788864786.543840:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdc81496800/0xf8c13e2d0e9590d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e9590cb expref: 18 pid: 5827 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864786.543851:0:8496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1875760546611840:0@lo:104: 00010000:00010000:3.0:1788864786.543861:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959077 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e959070 expref: 17 pid: 5830 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864786.543870:0:8496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1875760546611968:0@lo:104: 00010000:00010000:3.0:1788864786.543880:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdc81497400/0xf8c13e2d0e958ff9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e958ff2 expref: 16 pid: 5830 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864786.543887:0:8496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1875760546612096:0@lo:104: 00010000:00010000:3.0:1788864786.543913:0:8496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e959230 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864786.543921:0:8496:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e959230 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864786.543927:0:8496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e959230 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864786.543947:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e959230 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864787.020429:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864788.036870:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864788.185972:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864788.186048:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528759040 00000100:00100000:3.0:1788864788.186058:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528759040 00000100:00100000:3.0:1788864788.186129:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 172 00000100:00100000:3.0:1788864788.186139:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+9:5597:x1875760528759040:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788864788.186155:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864788.186172:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdb8213ec00/0xf8c13e2d0e959237 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fa31 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864788.186200:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdb8213ec00/0xf8c13e2d0e959237 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa31 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864788.186213:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdb8213ec00/0xf8c13e2d0e959237 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa31 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864788.186222:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213ec00, rc 0) 00000100:00100000:3.0:1788864788.186295:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+10:5597:x1875760528759040:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 157us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864788.186303:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 172 00000100:00100000:3.0:1788864788.199420:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864788.200790:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528759168 00000100:00100000:1.0:1788864788.200802:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528759168 00000100:00100000:1.0:1788864788.200850:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 173 00000100:00100000:1.0:1788864788.200859:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+10:5597:x1875760528759168:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788864788.201143:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+10:5597:x1875760528759168:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 284us (1731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864788.201158:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 173 00000100:00100000:1.0:1788864788.209412:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864788.210012:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528759296 00000100:00100000:2.0:1788864788.210024:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528759296 00000100:00100000:2.0:1788864788.210082:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 174 00000100:00100000:2.0:1788864788.210100:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+10:5597:x1875760528759296:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788864788.210322:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+10:5597:x1875760528759296:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 223us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864788.210330:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 174 00000100:00100000:2.0:1788864788.220722:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864788.220767:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528759424 00000100:00100000:2.0:1788864788.220776:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528759424 00000100:00100000:2.0:1788864788.220821:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 175 00000100:00100000:2.0:1788864788.220831:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+10:6168:x1875760528759424:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788864788.221068:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+10:6168:x1875760528759424:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 237us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864788.221076:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 175 00000100:00100000:2.0:1788864788.230767:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864788.230917:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528759552 00000100:00100000:1.0:1788864788.230929:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528759552 00000100:00100000:1.0:1788864788.230982:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 176 00000100:00100000:1.0:1788864788.230993:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+10:6168:x1875760528759552:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788864788.231218:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+10:6168:x1875760528759552:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 226us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864788.231227:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 176 10000000:01000000:3.0:1788864788.296624:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788864788.296633:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fdcbfd92000 from 4 10000000:01000000:3.0:1788864788.296638:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788864788.296688:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95923e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864788.296763:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95923e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864788.296775:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95923e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864788.296801:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0639f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546612608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788864788.296870:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864788.296907:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1fd0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788864788.299229:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546612608 00000100:00100000:2.0:1788864788.299241:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546612608 00000100:00100000:2.0:1788864788.299319:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788864788.299329:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:5832:x1875760546612608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788864788.299345:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864788.299361:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959245 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95923e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864788.299389:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95923e expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864788.299400:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95923e expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864788.299409:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcc2044e00, rc 0) 00000100:00100000:2.0:1788864788.299530:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546612608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (2659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864788.299537:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788864788.299593:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0639f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546612608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788864788.299611:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95923e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959245 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864788.299620:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95923e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e959245 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864788.299690:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546612736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788864788.299752:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864788.299778:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcb53036c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864788.299800:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546612736 00000100:00100000:2.0:1788864788.299804:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546612736 00000100:00100000:2.0:1788864788.299826:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788864788.299832:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546612736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788864788.303300:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546612736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3460us (3540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864788.303314:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788864788.305864:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546612736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788864788.305937:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbff01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546612864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788864788.306008:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864788.306050:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcb5307540 going to sleep for 11 seconds 00000100:00100000:2.0:1788864788.306099:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546612864 00000100:00100000:2.0:1788864788.306106:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546612864 00000100:00100000:2.0:1788864788.306159:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788864788.306168:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546612864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788864788.306378:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546612864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 210us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864788.306385:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788864788.306440:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbff01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546612864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788864788.306834:0:8572:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0639500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8572:1875760546612992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788864788.306871:0:8572:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864788.306889:0:8572:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1459900 going to sleep for 11 seconds 00000100:00100000:2.0:1788864788.307006:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546612992 00000100:00100000:2.0:1788864788.307407:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546612992 00000100:00100000:2.0:1788864788.307520:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788864788.307529:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:8572:x1875760546612992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788864788.308042:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:8572:x1875760546612992:12345-0@lo:502:llog_process_th.0 Request processed in 513us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864788.308060:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788864788.311280:0:8572:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0639500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8572:1875760546612992:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788864788.312615:0:8572:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788864788.312629:0:8572:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864788.312631:0:8572:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788864788.312638:0:8572:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fdcbfd92000 00000020:00000080:3.0:1788864788.312641:0:8572:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788864788.312759:0:8572:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0639500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8572:1875760546613120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788864788.312834:0:8572:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864788.312865:0:8572:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1459900 going to sleep for 11 seconds 00000100:00100000:3.0:1788864788.320569:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546613120 00000100:00100000:3.0:1788864788.320580:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546613120 00000100:00100000:3.0:1788864788.320627:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788864788.320636:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:8572:x1875760546613120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788864788.320898:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:8572:x1875760546613120:12345-0@lo:502:llog_process_th.0 Request processed in 262us (8063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864788.320911:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788864788.320969:0:8572:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0639500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8572:1875760546613120:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788864788.321001:0:8572:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788864788.321021:0:8572:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864788.321024:0:8572:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788864788.321028:0:8572:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788864788.323135:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788864788.323168:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788864788.323178:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95923e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959245 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864788.323191:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95923e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959245 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864788.323201:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788864788.323204:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fdcacbf0000 from 4 10000000:01000000:2.0:1788864788.323206:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788864788.323240:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e95924c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864788.323248:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e95924c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864788.323257:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e95924c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864788.323280:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546613248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788864788.323350:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864788.323382:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc83329480 going to sleep for 11 seconds 00000100:00100000:2.0:1788864788.323400:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546613248 00000100:00100000:2.0:1788864788.323406:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546613248 00000100:00100000:2.0:1788864788.323584:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788864788.323593:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546613248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788864788.323604:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864788.323622:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcc2045e00/0xf8c13e2d0e959253 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95924c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864788.323643:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcc2045e00/0xf8c13e2d0e959253 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95924c expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864788.323652:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcc2045e00/0xf8c13e2d0e959253 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95924c expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864788.323660:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcc2045e00, rc 0) 00000100:00100000:2.0:1788864788.323697:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546613248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864788.323721:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788864788.323769:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546613248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788864788.323784:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e95924c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959253 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864788.323791:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e95924c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e959253 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864788.323836:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546613376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788864788.323861:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864788.323885:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc83329480 going to sleep for 11 seconds 00000100:00100000:3.0:1788864788.324648:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546613376 00000100:00100000:3.0:1788864788.324656:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546613376 00000100:00100000:3.0:1788864788.324696:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788864788.324720:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546613376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788864788.324957:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546613376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864788.324965:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788864788.325002:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546613376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788864788.325978:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0639500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546613504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788864788.326091:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864788.326122:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfde3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788864788.326398:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546613504 00000100:00100000:2.0:1788864788.326404:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546613504 00000100:00100000:2.0:1788864788.326445:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788864788.326453:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546613504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788864788.326626:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546613504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864788.326640:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788864788.326891:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0639500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546613504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788864788.329614:0:8577:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8577:1875760546613632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788864788.329690:0:8577:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864788.329747:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546613632 00000100:00100000:2.0:1788864788.329754:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546613632 00000100:00100000:2.0:1788864788.329793:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788864788.329801:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:8577:x1875760546613632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788864788.329976:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:8577:x1875760546613632:12345-0@lo:502:llog_process_th.0 Request processed in 174us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864788.329984:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788864788.331579:0:8577:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc84e8f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864788.331612:0:8577:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8577:1875760546613632:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788864788.331648:0:8577:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788864788.331658:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864788.331661:0:8577:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788864788.331667:0:8577:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fdcacbf0000 00000020:00000080:2.0:1788864788.331669:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788864788.332107:0:8577:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8577:1875760546613760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788864788.332165:0:8577:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864788.332202:0:8577:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc14d19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864788.333349:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546613760 00000100:00100000:1.0:1788864788.333359:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546613760 00000100:00100000:1.0:1788864788.333402:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788864788.333411:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:8577:x1875760546613760:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788864788.333624:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:8577:x1875760546613760:12345-0@lo:502:llog_process_th.0 Request processed in 214us (1459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864788.333633:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788864788.335785:0:8577:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8577:1875760546613760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788864788.335826:0:8577:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788864788.335833:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864788.335835:0:8577:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788864788.335840:0:8577:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788864788.337041:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788864788.337065:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788864788.337076:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e95924c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959253 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864788.337100:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e95924c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959253 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864788.337110:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788864788.337112:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fdc8878e000 from 4 10000000:01000000:2.0:1788864788.337115:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788864788.337147:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044000/0xf8c13e2d0e95925a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864788.337154:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044000/0xf8c13e2d0e95925a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864788.337163:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044000/0xf8c13e2d0e95925a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864788.337186:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546613888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788864788.337243:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864788.337276:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc14d1300 going to sleep for 11 seconds 00000100:00100000:2.0:1788864788.337294:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546613888 00000100:00100000:2.0:1788864788.337299:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546613888 00000100:00100000:2.0:1788864788.337358:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788864788.337367:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546613888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788864788.337380:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864788.337391:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcc2045600/0xf8c13e2d0e959261 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95925a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864788.337412:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcc2045600/0xf8c13e2d0e959261 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95925a expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864788.338021:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcc2045600/0xf8c13e2d0e959261 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95925a expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864788.338030:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcc2045600, rc 0) 00000100:00100000:2.0:1788864788.338078:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:5832:x1875760546613888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 711us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864788.338086:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788864788.338136:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546613888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788864788.338150:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044000/0xf8c13e2d0e95925a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959261 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864788.338159:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044000/0xf8c13e2d0e95925a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e959261 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864788.338213:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546614016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788864788.338241:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864788.338262:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc14d1300 going to sleep for 11 seconds 00000100:00100000:1.0:1788864788.340269:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546614016 00000100:00100000:1.0:1788864788.340282:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546614016 00000100:00100000:1.0:1788864788.340333:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788864788.340344:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:5832:x1875760546614016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788864788.340615:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:5832:x1875760546614016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 274us (2372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864788.340624:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788864788.340672:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546614016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788864788.340760:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbff02680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546614144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788864788.340805:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864788.340832:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfdbe780 going to sleep for 11 seconds 00000100:00100000:1.0:1788864788.340844:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546614144 00000100:00100000:1.0:1788864788.340848:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546614144 00000100:00100000:1.0:1788864788.340875:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788864788.340881:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:5832:x1875760546614144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788864788.341025:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:5832:x1875760546614144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864788.341032:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788864788.341110:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbff02680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546614144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788864788.341675:0:8579:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbff02300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8579:1875760546614272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788864788.341764:0:8579:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864788.341786:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546614272 00000100:00100000:1.0:1788864788.341790:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546614272 00000100:00100000:1.0:1788864788.341813:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788864788.341819:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eeb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:8579:x1875760546614272:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788864788.341954:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eeb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:8579:x1875760546614272:12345-0@lo:502:llog_process_th.0 Request processed in 133us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864788.341961:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788864788.341998:0:8579:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfdbe780 going to sleep for 11 seconds 00000100:00100000:1.0:1788864788.342011:0:8579:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbff02300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8579:1875760546614272:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788864788.342039:0:8579:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788864788.342048:0:8579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864788.342050:0:8579:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788864788.342057:0:8579:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fdc8878e000 00000020:00000080:1.0:1788864788.342060:0:8579:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788864788.342386:0:8579:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbff02300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8579:1875760546614400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788864788.342420:0:8579:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864788.342440:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546614400 00000100:00100000:1.0:1788864788.342444:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546614400 00000100:00100000:1.0:1788864788.342466:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788864788.342472:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:8579:x1875760546614400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788864788.342585:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:8579:x1875760546614400:12345-0@lo:502:llog_process_th.0 Request processed in 112us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864788.342592:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788864788.342623:0:8579:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfdbe780 going to sleep for 11 seconds 00000100:00100000:1.0:1788864788.344785:0:8579:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbff02300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:8579:1875760546614400:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788864788.344821:0:8579:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788864788.344829:0:8579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864788.344831:0:8579:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788864788.344836:0:8579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788864788.344902:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788864788.344924:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788864788.344934:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044000/0xf8c13e2d0e95925a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959261 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864788.344946:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044000/0xf8c13e2d0e95925a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959261 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864789.060944:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864789.393422:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864789.393462:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864789.393502:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864789.393520:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528759680 00000100:00100000:3.0:1788864789.393530:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528759936 00000100:00100000:1.0:1788864789.393531:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528759680 00000100:00100000:3.0:1788864789.393539:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528759936 00000100:00100000:2.0:1788864789.393541:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864789.393569:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528760064 00000100:00100000:2.0:1788864789.393573:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528760064 00000100:00100000:1.0:1788864789.393597:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 192 00000100:00100000:3.0:1788864789.393603:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:1.0:1788864789.393609:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+10:2357:x1875760528759680:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788864789.393655:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528759808 00000100:00100000:0.0:1788864789.393662:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528759808 00000100:00100000:1.0:1788864789.393678:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+10:2357:x1875760528759680:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 72us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864789.393686:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 192 00000100:00100000:0.0:1788864789.393747:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:0.0:1788864789.393758:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2357:x1875760528759808:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864789.393823:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2357:x1875760528759936:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864789.393858:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2357:x1875760528759936:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 247us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864789.393941:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2357:x1875760528759808:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 185us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864789.393947:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:2.0:1788864789.400345:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:2.0:1788864789.400374:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2357:x1875760528760064:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788864789.400452:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2357:x1875760528760064:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 94us (6911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864789.400461:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00080000:2.0:1788864789.400665:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788864789.400670:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788864789.400673:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788864789.408403:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:0.0:1788864789.830339:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788864789.830372:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546614528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788864789.830475:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864789.831162:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546614528 00000100:00100000:1.0:1788864789.831174:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546614528 00000100:00080000:3.0:1788864789.831236:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788864789.831268:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788864789.831281:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546614528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788864789.831327:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788864789.831410:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546614528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864789.831418:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788864789.833085:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcac9f2a00 x1875760546614528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864789.833116:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546614528:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788864790.091823:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864790.861888:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbff02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546614656:0@lo:400:kworker.0 00000100:00100000:1.0:1788864790.861962:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864790.862007:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbff03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875760546615168:0@lo:400:kworker.0 00000100:00100000:1.0:1788864790.862032:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864790.862058:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788864790.862064:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbff00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546615040:0@lo:400:kworker.0 00000100:00100000:1.0:1788864790.862087:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864790.862114:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbff03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546614784:0@lo:400:kworker.0 00000100:00100000:1.0:1788864790.862135:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864790.862151:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbff03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546615296:0@lo:400:kworker.0 00000100:00100000:1.0:1788864790.862169:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864790.862185:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788864790.862190:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbff02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546614912:0@lo:400:kworker.0 00000100:00100000:1.0:1788864790.862210:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864790.862242:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546614656 00000100:00100000:1.0:1788864790.862249:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546614656 00000100:00100000:1.0:1788864790.862291:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788864790.862308:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3301:x1875760546614656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864790.862358:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3301:x1875760546614656:12345-0@lo:400:kworker.0 Request processed in 51us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864790.862366:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788864790.862394:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546615168 00000100:00100000:1.0:1788864790.862398:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546615168 00000100:00100000:1.0:1788864790.862429:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546614784 00000100:00100000:1.0:1788864790.862432:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546614784 00000100:00100000:1.0:1788864790.862442:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546614912 00000100:00100000:1.0:1788864790.862444:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546614912 00000100:00100000:1.0:1788864790.862458:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788864790.862464:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875760546615168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864790.862495:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875760546615168:12345-0@lo:400:kworker.0 Request processed in 30us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864790.862501:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788864790.862513:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788864790.862518:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546614784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864790.862547:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546614784:12345-0@lo:400:kworker.0 Request processed in 29us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864790.862552:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788864790.862563:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788864790.862568:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546614912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864790.862594:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546614912:12345-0@lo:400:kworker.0 Request processed in 26us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864790.862599:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788864790.862617:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546615040 00000100:00100000:1.0:1788864790.862620:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546615040 00000100:00100000:1.0:1788864790.862648:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546615296 00000100:00100000:1.0:1788864790.862651:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546615296 00000100:00100000:1.0:1788864790.862674:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788864790.862680:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546615040:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788864790.863542:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788864790.863550:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864790.863567:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788864790.863580:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546615296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864790.863629:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546615296:12345-0@lo:400:kworker.0 Request processed in 54us (1458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864790.863636:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788864790.863767:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546615040:12345-0@lo:400:kworker.0 Request processed in 1086us (1677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864790.863774:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788864790.863835:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbff02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546614912:0@lo:400:kworker.0 00000100:00100000:1.0:1788864790.863847:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbff03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546614784:0@lo:400:kworker.0 00010000:00080000:1.0:1788864790.863859:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcbff03b80 x1875760546615296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864790.863870:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbff03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546615296:0@lo:400:kworker.0 00010000:00080000:1.0:1788864790.863902:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcbff00e00 x1875760546615040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864790.863911:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbff00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546615040:0@lo:400:kworker.0 00000100:00100000:1.0:1788864790.863919:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbff02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546614656:0@lo:400:kworker.0 00000100:00100000:1.0:1788864790.863929:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbff03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875760546615168:0@lo:400:kworker.0 00010000:00010000:2.0:1788864791.108914:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864791.367561:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788864791.367584:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546615424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788864791.367653:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864791.367744:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546615424 00000100:00100000:2.0:1788864791.367752:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546615424 00000100:00100000:2.0:1788864791.367798:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788864791.367808:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546615424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788864791.367846:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788864791.367890:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546615424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864791.367897:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788864791.367946:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc9f45d180 x1875760546615424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864791.367964:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546615424:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788864792.132950:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788864792.935826:0:8795:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1788864793.163852:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864794.181288:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864794.517357:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864794.517557:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864794.517593:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528760320 00000100:00100000:2.0:1788864794.517606:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528760320 00000100:00100000:2.0:1788864794.517732:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:2.0:1788864794.517748:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2358:x1875760528760320:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788864794.517849:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2358:x1875760528760320:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 105us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864794.517858:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00080000:2.0:1788864794.518034:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864794.518875:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528760192 00000100:00100000:3.0:1788864794.518886:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528760192 00000100:00100000:3.0:1788864794.518953:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 194 00000100:00100000:3.0:1788864794.518962:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+10:2358:x1875760528760192:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864794.519068:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+10:2358:x1875760528760192:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 106us (1724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864794.519076:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 194 00000100:00100000:1.0:1788864794.534071:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864794.534124:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864794.534227:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528760448 00000100:00100000:3.0:1788864794.534240:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528760448 00000100:00080000:1.0:1788864794.534301:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788864794.534311:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528760576 00000100:00100000:3.0:1788864794.534315:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528760576 00000100:00100000:1.0:1788864794.534327:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:1.0:1788864794.534343:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2355:x1875760528760448:12345-192.168.203.13@tcp:9:kworker.0 00000100:00100000:3.0:1788864794.534350:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1788864794.534361:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2355:x1875760528760576:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:1.0:1788864794.534392:0:8199:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e95919d 00000020:00000080:3.0:1788864794.534406:0:6684:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e9591a4 00000100:00080000:1.0:1788864794.534417:0:8199:0:(import.c:65:import_set_state_nolock()) ffff9fdb819b0800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1788864794.534418:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9fdc9081c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788864794.534467:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788864794.535067:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+2:2355:x1875760528760576:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 705us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864794.535076:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00010000:00010000:3.0:1788864794.535110:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788864794.535117:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:1.0:1788864794.535121:0:8199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788864794.535357:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+2:2355:x1875760528760448:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 1018us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864794.535366:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00010000:00010000:0.0:1788864794.535612:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864794.949032:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788864794.949064:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546615552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788864794.949159:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864794.949351:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546615552 00000100:00100000:0.0:1788864794.949362:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546615552 00000100:00100000:0.0:1788864794.949443:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788864794.949455:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546615552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788864794.949513:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788864794.949584:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546615552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864794.949592:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788864794.950726:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788864794.950789:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcac9f2a00 x1875760546615552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864794.951038:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546615552:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788864795.207052:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864795.972970:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbff02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546616064:0@lo:400:kworker.0 00000100:00100000:1.0:1788864795.973066:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864795.973131:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788864795.973137:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbff03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546615680:0@lo:400:kworker.0 00000100:00100000:1.0:1788864795.973172:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864795.973194:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbff01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546616192:0@lo:400:kworker.0 00000100:00100000:1.0:1788864795.973218:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864795.973244:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbff03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546615808:0@lo:400:kworker.0 00000100:00100000:1.0:1788864795.973267:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864795.973286:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbff00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546616320:0@lo:400:kworker.0 00000100:00100000:1.0:1788864795.973308:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864795.973329:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788864795.973335:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbff02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546615936:0@lo:400:kworker.0 00000100:00100000:1.0:1788864795.973368:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864795.973400:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546616064 00000100:00100000:1.0:1788864795.973407:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546616064 00000100:00100000:1.0:1788864795.973453:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546616320 00000100:00100000:1.0:1788864795.973457:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546616320 00000100:00100000:1.0:1788864795.973486:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788864795.973495:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546616064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864795.973549:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546616064:12345-0@lo:400:kworker.0 Request processed in 55us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864795.973556:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788864795.973572:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788864795.973579:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546616320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864795.973613:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546616320:12345-0@lo:400:kworker.0 Request processed in 35us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864795.973619:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788864795.973637:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546615680 00000100:00100000:1.0:1788864795.973641:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546615680 00000100:00100000:1.0:1788864795.973689:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788864795.973696:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3300:x1875760546615680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864795.973754:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3300:x1875760546615680:12345-0@lo:400:kworker.0 Request processed in 58us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864795.973761:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788864795.973793:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546616192 00000100:00100000:1.0:1788864795.973796:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546616192 00000100:00100000:1.0:1788864795.973821:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546615808 00000100:00100000:1.0:1788864795.973824:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546615808 00000100:00100000:1.0:1788864795.973834:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546615936 00000100:00100000:1.0:1788864795.973836:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546615936 00000100:00100000:1.0:1788864795.973862:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788864795.973868:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546616192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864795.973902:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546616192:12345-0@lo:400:kworker.0 Request processed in 34us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864795.973909:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788864795.973925:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788864795.973932:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546615808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864795.973959:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546615808:12345-0@lo:400:kworker.0 Request processed in 28us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864795.973965:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788864795.973980:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788864795.973988:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546615936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864795.974013:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546615936:12345-0@lo:400:kworker.0 Request processed in 28us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864795.974019:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788864795.974046:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788864795.974050:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788864795.974085:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbff02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546615936:0@lo:400:kworker.0 00000100:00100000:1.0:1788864795.974095:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbff03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546615808:0@lo:400:kworker.0 00010000:00080000:1.0:1788864795.974105:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcbff00700 x1875760546616320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864795.974114:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbff00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546616320:0@lo:400:kworker.0 00000100:00100000:1.0:1788864795.974141:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbff03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546615680:0@lo:400:kworker.0 00000100:00100000:1.0:1788864795.974150:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbff01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546616192:0@lo:400:kworker.0 00010000:00080000:1.0:1788864795.974171:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcbff02680 x1875760546616064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864795.974179:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbff02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546616064:0@lo:400:kworker.0 00010000:00010000:1.0:1788864796.228986:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864796.484837:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788864796.484858:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546616448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788864796.484922:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864796.484981:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546616448 00000100:00100000:2.0:1788864796.485060:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546616448 00000100:00100000:2.0:1788864796.485109:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788864796.485118:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546616448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788864796.485155:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788864796.485201:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546616448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864796.485208:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788864796.485246:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc9f45c380 x1875760546616448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864812 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864796.485278:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546616448:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1788864797.054894:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1cf2dd0f-7f2d-465e-9303-244222bc89bf 00000020:00000080:2.0:1788864797.054904:0:6709:0:(genops.c:885:class_export_put()) final put ffff9fdb819b1000/1cf2dd0f-7f2d-465e-9303-244222bc89bf 00000020:00000080:3.0:1788864797.054959:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdb819b1000/1cf2dd0f-7f2d-465e-9303-244222bc89bf for lustre-OST0000 00000020:00000080:3.0:1788864797.055006:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fdb819b0800 for lustre-OST0000 00000001:02000400:2.0:1788864797.237085:0:9039:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing yml_node 00010000:00010000:0.0:1788864797.258330:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864798.278068:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788864798.605466:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1cf2dd0f-7f2d-465e-9303-244222bc89bf 00000020:00000080:2.0:1788864798.605476:0:7636:0:(genops.c:885:class_export_put()) final put ffff9fdc90819800/1cf2dd0f-7f2d-465e-9303-244222bc89bf 00000020:00000080:3.0:1788864798.605559:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdc90819800/1cf2dd0f-7f2d-465e-9303-244222bc89bf for lustre-OST0001 00000020:00000080:3.0:1788864798.605617:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fdc9081c000 for lustre-OST0001 00010000:00010000:0.0:1788864799.300900:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864799.633570:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864799.633626:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864799.633958:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528760832 00000100:00100000:2.0:1788864799.633968:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528760832 00000100:00080000:0.0:1788864799.634247:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788864799.634536:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:2.0:1788864799.634553:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2356:x1875760528760832:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788864799.634635:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2356:x1875760528760832:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 87us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864799.634697:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528760704 00000100:00100000:3.0:1788864799.634721:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528760704 00000100:00100000:3.0:1788864799.634758:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 196 00000100:00100000:3.0:1788864799.634766:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+10:2356:x1875760528760704:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864799.634796:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+10:2356:x1875760528760704:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 31us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864799.634803:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 196 00000100:00100000:2.0:1788864799.635802:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:2.0:1788864800.069084:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788864800.069108:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546616576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788864800.069187:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864800.069439:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546616576 00000100:00100000:0.0:1788864800.069448:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546616576 00000100:00100000:0.0:1788864800.069518:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788864800.069528:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546616576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788864800.069562:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788864800.069609:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546616576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864800.069616:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788864800.069723:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788864800.069751:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcac9f1880 x1875760546616576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864800.069768:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546616576:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788864800.325331:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864801.094094:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546616704:0@lo:400:kworker.0 00000100:00100000:0.0:1788864801.094190:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864801.097804:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546616832:0@lo:400:kworker.0 00000100:00100000:1.0:1788864801.097902:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864801.103260:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875760546617216:0@lo:400:kworker.0 00000100:00100000:0.0:1788864801.103364:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864801.103436:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788864801.103444:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546617088:0@lo:400:kworker.0 00000100:00100000:0.0:1788864801.103474:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864801.103518:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875760546616960:0@lo:400:kworker.0 00000100:00100000:0.0:1788864801.105912:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864801.106016:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546616704 00000100:00100000:0.0:1788864801.106027:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546616704 00000100:00100000:0.0:1788864801.106095:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788864801.106106:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3301:x1875760546616704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864801.106172:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3301:x1875760546616704:12345-0@lo:400:kworker.0 Request processed in 69us (11982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864801.106180:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788864801.106220:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546616832 00000100:00100000:0.0:1788864801.106225:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546616832 00000100:00100000:0.0:1788864801.106263:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546617216 00000100:00100000:0.0:1788864801.106266:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546617216 00000100:00100000:0.0:1788864801.106291:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546616960 00000100:00100000:0.0:1788864801.106294:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546616960 00000100:00100000:0.0:1788864801.106310:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788864801.106317:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546616832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864801.106352:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546616832:12345-0@lo:400:kworker.0 Request processed in 36us (8451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864801.106359:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788864801.106369:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788864801.106375:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875760546617216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864801.106400:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875760546617216:12345-0@lo:400:kworker.0 Request processed in 25us (3037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864801.106405:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788864801.106415:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788864801.106421:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875760546616960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864801.106449:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875760546616960:12345-0@lo:400:kworker.0 Request processed in 29us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864801.106455:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788864801.106474:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546617088 00000100:00100000:0.0:1788864801.106486:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546617088 00000100:00100000:0.0:1788864801.106515:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788864801.106521:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546617088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864801.106790:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546617088:12345-0@lo:400:kworker.0 Request processed in 267us (3314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864801.106797:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788864801.106821:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788864801.106860:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875760546616960:0@lo:400:kworker.0 00010000:00080000:0.0:1788864801.106909:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcac9f0380 x1875760546617088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864801.106920:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546617088:0@lo:400:kworker.0 00000100:00100000:0.0:1788864801.106932:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546616704:0@lo:400:kworker.0 00000100:00100000:0.0:1788864801.106945:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875760546617216:0@lo:400:kworker.0 00000100:00100000:1.0:1788864801.107053:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546616832:0@lo:400:kworker.0 00000100:00100000:1.0:1788864801.107067:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546617344:0@lo:400:kworker.0 00000100:00100000:1.0:1788864801.107103:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864801.107217:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546617344 00000100:00100000:0.0:1788864801.107223:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546617344 00000100:00100000:0.0:1788864801.107297:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788864801.107305:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546617344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864801.107343:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546617344:12345-0@lo:400:kworker.0 Request processed in 39us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864801.107350:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788864801.107377:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcac9f2a00 x1875760546617344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864801.107387:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546617344:0@lo:400:kworker.0 00000100:00080000:1.0:1788864801.110917:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:2.0:1788864801.120412:0:9233:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:0.0:1788864801.356431:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864801.604876:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788864801.604906:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546617472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788864801.605000:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864801.605082:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546617472 00000100:00100000:3.0:1788864801.605095:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546617472 00000100:00100000:3.0:1788864801.605182:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788864801.605194:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546617472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788864801.605242:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788864801.605306:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546617472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864801.605322:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788864801.605591:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc9f45f800 x1875760546617472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864801.605614:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546617472:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788864802.373041:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864803.399003:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788864803.531118:0:9330:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:0.0:1788864804.420966:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864804.753872:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864804.754246:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528760960 00000100:00100000:3.0:1788864804.754256:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528760960 00000100:00100000:3.0:1788864804.754314:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 198 00000100:00100000:3.0:1788864804.754324:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+10:2358:x1875760528760960:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864804.754393:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+10:2358:x1875760528760960:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 71us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864804.754400:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 198 00000100:00100000:1.0:1788864804.757240:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864804.757510:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528761088 00000100:00100000:0.0:1788864804.757519:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528761088 00000100:00100000:0.0:1788864804.757593:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:0.0:1788864804.757604:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2358:x1875760528761088:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788864804.757692:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2358:x1875760528761088:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 90us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864804.757700:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00080000:2.0:1788864804.758133:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788864805.189651:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788864805.189673:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546617600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788864805.189776:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864805.189977:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546617600 00000100:00100000:3.0:1788864805.189986:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546617600 00000100:00080000:2.0:1788864805.190094:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788864805.190305:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788864805.190320:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546617600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788864805.190356:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788864805.190413:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546617600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864805.190421:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1788864805.190499:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcac9f2a00 x1875760546617600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864805.190517:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546617600:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788864805.453640:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788864805.718464:0:9429:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00000100:00100000:3.0:1788864806.212959:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc063a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875760546617984:0@lo:400:kworker.0 00000100:00100000:3.0:1788864806.213023:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864806.213076:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788864806.213082:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875760546617856:0@lo:400:kworker.0 00000100:00100000:3.0:1788864806.213103:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864806.213131:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc063aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546618368:0@lo:400:kworker.0 00000100:00100000:3.0:1788864806.213154:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864806.213189:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546618368 00000100:00100000:3.0:1788864806.213197:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546618368 00000100:00080000:0.0:1788864806.213229:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788864806.213272:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788864806.213283:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc063bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546618368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864806.213286:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc063a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546618112:0@lo:400:kworker.0 00000100:00100000:1.0:1788864806.213330:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864806.213358:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc063bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546618368:12345-0@lo:400:kworker.0 Request processed in 77us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864806.213362:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788864806.213369:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788864806.213372:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0638700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546617728:0@lo:400:kworker.0 00000100:00100000:3.0:1788864806.213387:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546618112 00000100:00100000:3.0:1788864806.213392:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546618112 00000100:00100000:1.0:1788864806.213407:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864806.213418:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788864806.213426:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546618112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864806.213437:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc063b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546618240:0@lo:400:kworker.0 00000100:00100000:3.0:1788864806.213468:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546618112:12345-0@lo:400:kworker.0 Request processed in 42us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864806.213473:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864806.213482:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788864806.213511:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcc063a300 x1875760546618112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788864806.213522:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcc063aa00 x1875760546618368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864806.213553:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc063aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546618368:0@lo:400:kworker.0 00000100:00100000:3.0:1788864806.213594:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546617984 00000100:00100000:3.0:1788864806.213598:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546617984 00000100:00100000:3.0:1788864806.213635:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546617856 00000100:00100000:3.0:1788864806.213638:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546617856 00000100:00100000:3.0:1788864806.213651:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546618240 00000100:00100000:3.0:1788864806.213653:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546618240 00000100:00080000:0.0:1788864806.213662:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864806.213670:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788864806.213678:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0638e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875760546617984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864806.213691:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788864806.213724:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc063b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875760546617856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864806.213758:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0638e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875760546617984:12345-0@lo:400:kworker.0 Request processed in 78us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864806.213765:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788864806.213774:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc063b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875760546617856:12345-0@lo:400:kworker.0 Request processed in 74us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864806.213782:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788864806.213790:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546618240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864806.213812:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc063a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546618112:0@lo:400:kworker.0 00000100:00100000:3.0:1788864806.213821:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546618240:12345-0@lo:400:kworker.0 Request processed in 30us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864806.213837:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc063b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546618240:0@lo:400:kworker.0 00000100:00100000:1.0:1788864806.213876:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546617728 00000100:00100000:1.0:1788864806.213880:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546617728 00000100:00100000:2.0:1788864806.213916:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875760546617856:0@lo:400:kworker.0 00000100:00100000:1.0:1788864806.213919:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788864806.213932:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3300:x1875760546617728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864806.213937:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc063a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875760546617984:0@lo:400:kworker.0 00000100:00100000:1.0:1788864806.213977:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3300:x1875760546617728:12345-0@lo:400:kworker.0 Request processed in 48us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864806.213984:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788864806.214016:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0638700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546617728:0@lo:400:kworker.0 00000100:00100000:0.0:1788864806.216200:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788864806.217379:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:0.0:1788864806.469199:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864806.725129:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788864806.725152:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546618496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788864806.725230:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864806.725376:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546618496 00000100:00100000:2.0:1788864806.725386:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546618496 00000100:00100000:2.0:1788864806.725443:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788864806.725452:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546618496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788864806.725484:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788864806.725529:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546618496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864806.725536:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788864806.725697:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc9f45f480 x1875760546618496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864822 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864806.725813:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546618496:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788864807.176299:0:9477:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 8 06:53:25 EDT 2026 00010000:00010000:0.0:1788864807.493957:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864808.516945:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864809.543618:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864809.879104:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864809.879139:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864809.879252:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528761344 00000100:00100000:3.0:1788864809.879263:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528761344 00000100:00100000:3.0:1788864809.879329:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:3.0:1788864809.879340:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2356:x1875760528761344:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864809.879420:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2356:x1875760528761344:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 81us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864809.879428:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:2.0:1788864809.880638:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528761216 00000100:00100000:2.0:1788864809.880648:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528761216 00000100:00100000:2.0:1788864809.880688:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 200 00000100:00100000:2.0:1788864809.880695:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+10:2357:x1875760528761216:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788864809.880763:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+10:2357:x1875760528761216:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 69us (1678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864809.880770:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 200 00000100:00080000:0.0:1788864809.883854:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788864810.308857:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546618624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788864810.308920:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864810.309000:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546618624 00000100:00100000:2.0:1788864810.309007:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546618624 00000100:00100000:2.0:1788864810.309060:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788864810.309069:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546618624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788864810.309101:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788864810.309161:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546618624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864810.309170:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788864810.309196:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788864810.309228:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc9f45e300 x1875760546618624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864810.309246:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546618624:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788864810.567146:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864811.335161:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546619136:0@lo:400:kworker.0 00000100:00100000:3.0:1788864811.335242:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864811.335309:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788864811.335315:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546618752:0@lo:400:kworker.0 00000100:00100000:3.0:1788864811.335339:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864811.335356:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546619264:0@lo:400:kworker.0 00000100:00100000:3.0:1788864811.335374:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864811.335398:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875760546619008:0@lo:400:kworker.0 00000100:00100000:3.0:1788864811.335441:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864811.335473:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788864811.335478:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875760546618880:0@lo:400:kworker.0 00000100:00100000:3.0:1788864811.335497:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864811.335511:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546619392:0@lo:400:kworker.0 00000100:00100000:3.0:1788864811.335529:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864811.335553:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546619264 00000100:00100000:3.0:1788864811.335560:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546619264 00000100:00100000:3.0:1788864811.335618:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546619008 00000100:00100000:3.0:1788864811.335621:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546619008 00000100:00100000:3.0:1788864811.335633:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546618880 00000100:00100000:3.0:1788864811.335635:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546618880 00000100:00100000:3.0:1788864811.335648:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788864811.335656:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546619264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864811.335728:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546619264:12345-0@lo:400:kworker.0 Request processed in 72us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864811.335734:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788864811.335752:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788864811.335760:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc063a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875760546619008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864811.335789:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc063a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875760546619008:12345-0@lo:400:kworker.0 Request processed in 31us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864811.335795:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788864811.335806:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788864811.335811:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875760546618880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864811.335835:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875760546618880:12345-0@lo:400:kworker.0 Request processed in 24us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864811.335840:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788864811.335860:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546619136 00000100:00100000:3.0:1788864811.335870:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546619136 00000100:00100000:3.0:1788864811.335894:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546619392 00000100:00100000:3.0:1788864811.335897:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546619392 00000100:00100000:3.0:1788864811.335915:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788864811.335921:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc063aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546619136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864811.335949:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc063aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546619136:12345-0@lo:400:kworker.0 Request processed in 29us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864811.335954:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788864811.335963:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788864811.335968:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc063b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546619392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864811.335990:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc063b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546619392:12345-0@lo:400:kworker.0 Request processed in 22us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864811.335995:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788864811.336032:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875760546618880:0@lo:400:kworker.0 00010000:00080000:3.0:1788864811.336044:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc9f45f800 x1875760546619392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864811.336053:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546619392:0@lo:400:kworker.0 00000100:00100000:3.0:1788864811.336061:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875760546619008:0@lo:400:kworker.0 00000100:00100000:3.0:1788864811.336091:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546619264:0@lo:400:kworker.0 00010000:00080000:3.0:1788864811.336100:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc9f45ed80 x1875760546619136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864811.336107:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546619136:0@lo:400:kworker.0 00000100:00100000:1.0:1788864811.336590:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546618752 00000100:00100000:1.0:1788864811.336595:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546618752 00000100:00100000:1.0:1788864811.336634:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788864811.336641:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3300:x1875760546618752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864811.336686:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3300:x1875760546618752:12345-0@lo:400:kworker.0 Request processed in 46us (1346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864811.336701:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788864811.336784:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546618752:0@lo:400:kworker.0 00000100:00080000:2.0:1788864811.336955:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788864811.336960:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788864811.590897:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864811.846504:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546619520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788864811.846581:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864811.847460:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546619520 00000100:00100000:2.0:1788864811.847470:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546619520 00000100:00100000:2.0:1788864811.847522:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788864811.847532:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546619520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788864811.847575:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788864811.847635:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546619520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864811.847643:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788864811.847821:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc9f45e300 x1875760546619520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864811.847843:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546619520:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788864812.612936:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864813.648431:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864814.660950:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864814.993242:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864814.993292:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864814.993381:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528761472 00000100:00100000:3.0:1788864814.993407:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528761472 00000100:00100000:3.0:1788864814.993477:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 202 00000100:00100000:3.0:1788864814.993489:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+10:2358:x1875760528761472:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864814.993595:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+10:2358:x1875760528761472:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 108us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864814.993603:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 202 00000100:00100000:2.0:1788864814.993825:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528761600 00000100:00100000:2.0:1788864814.993831:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528761600 00000100:00100000:2.0:1788864814.993887:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:2.0:1788864814.993903:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2358:x1875760528761600:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788864814.993946:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2358:x1875760528761600:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 44us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864814.993953:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00080000:3.0:1788864814.994151:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788864815.428891:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788864815.428924:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546619648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788864815.429017:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864815.429155:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546619648 00000100:00100000:2.0:1788864815.429166:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546619648 00000100:00100000:2.0:1788864815.429248:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788864815.429260:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546619648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788864815.429306:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788864815.429366:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546619648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864815.429374:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788864815.429433:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc9f45ed80 x1875760546619648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864815.429454:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546619648:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788864815.429594:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788864815.686492:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864816.470360:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788864816.470381:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0639500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875760546619904:0@lo:400:kworker.0 00000100:00100000:3.0:1788864816.470513:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864816.470589:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546619904 00000100:00100000:3.0:1788864816.470598:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546619904 00000100:00100000:3.0:1788864816.470646:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788864816.470656:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875760546619904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864816.470739:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875760546619904:12345-0@lo:400:kworker.0 Request processed in 85us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864816.470747:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788864816.470789:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0639500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875760546619904:0@lo:400:kworker.0 00000100:00100000:3.0:1788864816.470824:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0639500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875760546620032:0@lo:400:kworker.0 00000100:00100000:3.0:1788864816.470848:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864816.470882:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546620032 00000100:00100000:3.0:1788864816.470886:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546620032 00000100:00100000:3.0:1788864816.470919:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788864816.471040:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc063a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546619776:0@lo:400:kworker.0 00000100:00100000:2.0:1788864816.471076:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864816.473043:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875760546620032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864816.473249:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875760546620032:12345-0@lo:400:kworker.0 Request processed in 2204us (2281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864816.473270:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1788864816.473308:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864816.473327:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546619776 00000100:00100000:3.0:1788864816.473334:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546619776 00000100:00100000:3.0:1788864816.473368:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788864816.473376:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3301:x1875760546619776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864816.473414:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3301:x1875760546619776:12345-0@lo:400:kworker.0 Request processed in 39us (2337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864816.473420:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788864816.473463:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc063a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546619776:0@lo:400:kworker.0 00000100:00100000:3.0:1788864816.473520:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788864816.473528:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc063a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546620160:0@lo:400:kworker.0 00000100:00100000:3.0:1788864816.473569:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864816.473599:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546620160 00000100:00100000:3.0:1788864816.473602:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546620160 00000100:00100000:3.0:1788864816.473630:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788864816.473636:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0638000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546620160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864816.473668:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0638000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546620160:12345-0@lo:400:kworker.0 Request processed in 33us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864816.473675:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788864816.473700:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcc063a300 x1875760546620160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864816.473730:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc063a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546620160:0@lo:400:kworker.0 00000100:00100000:3.0:1788864816.473760:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc063a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875760546620288:0@lo:400:kworker.0 00000100:00100000:3.0:1788864816.473783:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864816.473818:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546620288 00000100:00100000:3.0:1788864816.473822:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546620288 00000100:00100000:3.0:1788864816.473851:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788864816.473858:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875760546620288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864816.473892:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875760546620288:12345-0@lo:400:kworker.0 Request processed in 34us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864816.473898:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788864816.473912:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788864816.480089:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0639500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875760546620032:0@lo:400:kworker.0 00000100:00100000:3.0:1788864816.480302:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc063a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875760546620288:0@lo:400:kworker.0 00000100:00100000:1.0:1788864816.480615:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc063a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546620416:0@lo:400:kworker.0 00000100:00100000:1.0:1788864816.480682:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864816.481288:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546620416 00000100:00100000:3.0:1788864816.481297:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546620416 00000100:00100000:3.0:1788864816.481366:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788864816.481376:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546620416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864816.481447:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546620416:12345-0@lo:400:kworker.0 Request processed in 73us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864816.481454:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1788864816.481513:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788864816.481632:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcc063a300 x1875760546620416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864816.481643:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc063a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546620416:0@lo:400:kworker.0 00010000:00010000:0.0:1788864816.711832:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864816.964988:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788864816.966159:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546620544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788864816.966226:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864816.968098:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546620544 00000100:00100000:2.0:1788864816.968110:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546620544 00000100:00100000:2.0:1788864816.968178:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788864816.968188:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546620544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788864816.968225:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788864816.968357:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546620544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 171us (2130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864816.968377:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788864816.976904:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc9f45ed80 x1875760546620544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864832 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864816.976942:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546620544:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788864817.736214:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864818.760989:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864819.782280:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864820.115551:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864820.115660:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864820.118456:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528761856 00000100:00100000:3.0:1788864820.118470:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528761856 00000100:00100000:3.0:1788864820.118571:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:3.0:1788864820.118582:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2358:x1875760528761856:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864820.118662:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2358:x1875760528761856:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 82us (3002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864820.118669:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00080000:0.0:1788864820.119005:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788864820.120910:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528761728 00000100:00100000:2.0:1788864820.120922:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528761728 00000100:00100000:2.0:1788864820.121030:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 204 00000100:00100000:2.0:1788864820.121041:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+10:2358:x1875760528761728:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788864820.121117:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+10:2358:x1875760528761728:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 78us (5575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864820.121125:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 204 00000100:00100000:1.0:1788864820.548913:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546620672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788864820.548982:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864820.549112:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546620672 00000100:00100000:2.0:1788864820.549120:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546620672 00000100:00100000:2.0:1788864820.549189:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788864820.549199:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546620672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788864820.549230:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788864820.549281:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546620672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864820.549288:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788864820.549325:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc9f45f480 x1875760546620672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864820.549343:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546620672:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788864820.549469:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788864820.808065:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864821.581543:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788864821.581770:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546620928:0@lo:400:kworker.0 00000100:00100000:1.0:1788864821.581868:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864821.581948:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788864821.581956:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546621056:0@lo:400:kworker.0 00000100:00100000:1.0:1788864821.581990:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864821.582032:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546620928 00000100:00100000:1.0:1788864821.582042:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546620928 00000100:00100000:1.0:1788864821.582095:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546621056 00000100:00100000:1.0:1788864821.582110:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546621056 00000100:00100000:1.0:1788864821.582146:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788864821.582156:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546620928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864821.582229:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546620928:12345-0@lo:400:kworker.0 Request processed in 73us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864821.582237:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788864821.582258:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788864821.582264:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546621056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864821.582307:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546621056:12345-0@lo:400:kworker.0 Request processed in 43us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864821.582314:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1788864821.582341:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788864821.582377:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546621056:0@lo:400:kworker.0 00000100:00100000:1.0:1788864821.582389:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546620928:0@lo:400:kworker.0 00000100:00100000:0.0:1788864821.584661:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546621184:0@lo:400:kworker.0 00000100:00100000:0.0:1788864821.584791:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864821.584840:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546620800:0@lo:400:kworker.0 00000100:00100000:0.0:1788864821.584870:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864821.585028:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546621184 00000100:00100000:3.0:1788864821.585038:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546621184 00000100:00100000:3.0:1788864821.585089:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788864821.585108:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546621184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864821.585166:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546621184:12345-0@lo:400:kworker.0 Request processed in 68us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864821.585173:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788864821.585861:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc9f45f800 x1875760546621184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864821.585877:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546621184:0@lo:400:kworker.0 00000100:00100000:0.0:1788864821.588299:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875760546621312:0@lo:400:kworker.0 00000100:00100000:0.0:1788864821.588392:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864821.588581:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788864821.588596:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546621440:0@lo:400:kworker.0 00000100:00100000:2.0:1788864821.588636:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864821.588673:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546621440 00000100:00100000:2.0:1788864821.588683:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546621440 00000100:00100000:2.0:1788864821.588776:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788864821.588804:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546621440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864821.588864:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546621440:12345-0@lo:400:kworker.0 Request processed in 62us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864821.588871:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788864821.588928:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc9f45f800 x1875760546621440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864821.588942:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546621440:0@lo:400:kworker.0 00000100:00100000:1.0:1788864821.591242:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546620800 00000100:00100000:1.0:1788864821.591260:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546620800 00000100:00100000:1.0:1788864821.591573:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788864821.591586:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3300:x1875760546620800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864821.591694:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3300:x1875760546620800:12345-0@lo:400:kworker.0 Request processed in 111us (6822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864821.591720:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788864821.591773:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546621312 00000100:00100000:1.0:1788864821.591795:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546621312 00000100:00100000:1.0:1788864821.591835:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788864821.591843:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875760546621312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864821.597269:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875760546621312:12345-0@lo:400:kworker.0 Request processed in 5410us (8861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864821.597300:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1788864821.597373:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788864821.597381:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788864821.600857:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875760546621312:0@lo:400:kworker.0 00000100:00100000:0.0:1788864821.601009:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546620800:0@lo:400:kworker.0 00010000:00010000:1.0:1788864821.830616:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864822.085933:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546621568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788864822.086022:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864822.086283:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546621568 00000100:00100000:2.0:1788864822.086293:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546621568 00000100:00100000:2.0:1788864822.086351:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788864822.086362:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546621568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788864822.086405:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788864822.086471:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546621568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864822.086479:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788864822.086801:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc9f45f800 x1875760546621568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864822.087051:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546621568:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788864822.241079:0:10107:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 06:53:40 (1788864820) === 00000100:00100000:1.0:1788864822.703636:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864822.703892:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528761984 00000100:00100000:2.0:1788864822.703905:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528761984 00000100:00100000:2.0:1788864822.703977:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 206 00000100:00100000:2.0:1788864822.703999:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+10:8161:x1875760528761984:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788864822.704023:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864822.704048:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcc2045000/0xf8c13e2d0e959268 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fa38 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864822.704087:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcc2045000/0xf8c13e2d0e959268 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa38 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864822.704100:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcc2045000/0xf8c13e2d0e959268 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa38 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864822.704129:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcc2045000, rc 0) 00000100:00100000:2.0:1788864822.704209:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+11:8161:x1875760528761984:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 222us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864822.704216:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 206 00000100:00100000:0.0:1788864822.711989:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864822.712355:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528762112 00000100:00100000:2.0:1788864822.712369:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528762112 00000100:00100000:2.0:1788864822.712457:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 207 00000100:00100000:2.0:1788864822.712471:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+11:8161:x1875760528762112:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788864822.712952:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+11:8161:x1875760528762112:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 483us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864822.712962:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 207 00000100:00100000:3.0:1788864822.720149:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864822.720263:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528762240 00000100:00100000:1.0:1788864822.720276:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528762240 00000100:00100000:1.0:1788864822.720350:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 208 00000100:00100000:1.0:1788864822.720362:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+11:8161:x1875760528762240:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788864822.723520:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+11:8161:x1875760528762240:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 3145us (3371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864822.723538:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 208 00000100:00100000:1.0:1788864822.726672:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864822.726831:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528762368 00000100:00100000:2.0:1788864822.726845:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528762368 00000100:00100000:2.0:1788864822.726920:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:2.0:1788864822.726933:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+11:8165:x1875760528762368:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788864822.727960:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+11:8165:x1875760528762368:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 1022us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864822.727973:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:0.0:1788864822.744231:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864822.744332:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528762496 00000100:00100000:1.0:1788864822.744345:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528762496 00000100:00100000:1.0:1788864822.744451:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00100000:1.0:1788864822.744463:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+11:8165:x1875760528762496:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788864822.744877:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+11:8165:x1875760528762496:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 416us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864822.744887:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00100000:3.0:1788864822.758507:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864822.758597:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528762624 00000100:00100000:2.0:1788864822.758611:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528762624 00000100:00100000:2.0:1788864822.758678:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 211 00000100:00100000:2.0:1788864822.758691:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+11:8161:x1875760528762624:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788864822.758754:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864822.758779:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcc2044400/0xf8c13e2d0e95926f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fa62 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864822.758834:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcc2044400/0xf8c13e2d0e95926f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa62 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864822.758848:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcc2044400/0xf8c13e2d0e95926f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa62 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864822.758859:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcc2044400, rc 0) 00000100:00100000:2.0:1788864822.758924:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+12:8161:x1875760528762624:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 236us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864822.758932:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 211 00000100:00100000:3.0:1788864822.768052:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864822.768211:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528762752 00000100:00100000:1.0:1788864822.768225:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528762752 00000100:00100000:1.0:1788864822.768295:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 212 00000100:00100000:1.0:1788864822.768310:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+12:8161:x1875760528762752:12345-192.168.203.13@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788864822.768346:0:5827:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788864822.768388:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788864822.768393:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788864822.768396:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788864822.768399:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788864822.770625:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+12:8161:x1875760528762752:12345-192.168.203.13@tcp:256:mount.lustre.0 Request processed in 2305us (2575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864822.770643:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 212 00000100:00100000:0.0:1788864822.773786:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864822.773896:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528762880 00000100:00100000:2.0:1788864822.773911:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528762880 00000100:00100000:2.0:1788864822.773980:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 213 00000100:00100000:2.0:1788864822.773992:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+12:8161:x1875760528762880:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788864822.774015:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864822.774071:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcb5385400/0xf8c13e2d0e959276 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fa69 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864822.774120:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcb5385400/0xf8c13e2d0e959276 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa69 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864822.774135:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcb5385400/0xf8c13e2d0e959276 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa69 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864822.774147:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385400, rc 0) 00000100:00100000:2.0:1788864822.774513:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:8161:x1875760528762880:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 521us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864822.774534:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 213 00000100:00100000:3.0:1788864822.777583:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864822.777754:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528763008 00000100:00100000:1.0:1788864822.777767:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528763008 00000100:00100000:1.0:1788864822.777837:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 214 00000100:00100000:1.0:1788864822.777849:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+13:8161:x1875760528763008:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788864822.787793:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+13:8161:x1875760528763008:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 9928us (10208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864822.787812:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 214 00000100:00100000:0.0:1788864822.792575:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864822.792790:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528763136 00000100:00100000:2.0:1788864822.792804:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528763136 00000100:00100000:2.0:1788864822.793290:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 215 00000100:00100000:2.0:1788864822.793307:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:8161:x1875760528763136:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788864822.793998:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:8161:x1875760528763136:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 692us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864822.794329:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 215 00000100:00100000:0.0:1788864822.807897:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864822.812189:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528763264 00000100:00100000:2.0:1788864822.812342:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528763264 00000100:00100000:2.0:1788864822.812559:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 216 00000100:00100000:2.0:1788864822.812574:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+13:8170:x1875760528763264:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788864822.812969:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+13:8170:x1875760528763264:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 396us (5087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864822.812978:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 216 00000100:00100000:3.0:1788864822.820518:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864822.820678:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528763392 00000100:00100000:2.0:1788864822.820691:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528763392 00000100:00100000:2.0:1788864822.820792:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 217 00000100:00100000:2.0:1788864822.820804:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:8170:x1875760528763392:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788864822.823670:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:8170:x1875760528763392:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 2846us (3158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864822.823691:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 217 00000100:00100000:0.0:1788864822.840820:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864822.840989:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528763904 00000100:00100000:1.0:1788864822.841004:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528763904 00000100:00100000:1.0:1788864822.841124:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:1.0:1788864822.841139:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2357:x1875760528763904:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788864822.841563:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2357:x1875760528763904:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 427us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864822.841602:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:0.0:1788864822.841921:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864822.842149:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528763520 00000100:00100000:1.0:1788864822.842157:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528763520 00000100:00100000:1.0:1788864822.842200:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:1.0:1788864822.842206:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2355:x1875760528763520:12345-192.168.203.13@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788864822.842238:0:5835:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 36a5d9c7-7504-4a4b-a03e-664186d01d07@192.168.203.13@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:1.0:1788864822.842283:0:5835:0:(genops.c:1384:class_connect()) connect: client 36a5d9c7-7504-4a4b-a03e-664186d01d07, cookie 0xf8c13e2d0e95927d 00000004:00100000:1.0:1788864822.842325:0:5835:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788864822.842760:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9fdcc0034800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788864822.842828:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36a5d9c7-7504-4a4b-a03e-664186d01d07+6:2355:x1875760528763520:12345-192.168.203.13@tcp:38:mount.lustre.0 Request processed in 619us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864822.842838:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00080000:2.0:1788864822.843055:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864822.849628:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864822.849739:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528763776 00000100:00100000:1.0:1788864822.849753:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528763776 00000100:00100000:1.0:1788864822.849853:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:1.0:1788864822.849867:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+6:8161:x1875760528763776:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788864822.849934:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788864822.850071:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+6:8161:x1875760528763776:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 207us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864822.850080:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00080000:2.0:1788864822.850851:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788864822.856473:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864822.859900:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864822.859949:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864822.860107:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528763648 00000100:00100000:3.0:1788864822.860120:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528763648 00000100:00100000:3.0:1788864822.860479:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528764032 00000100:00100000:3.0:1788864822.860483:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528764032 00000100:00100000:2.0:1788864822.864642:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:2.0:1788864822.864685:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+7:0:x1875760528763648:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788864822.864757:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788864822.864890:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+7:0:x1875760528763648:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 230us (5005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864822.864899:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:2.0:1788864822.864937:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:2.0:1788864822.864946:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+6:8161:x1875760528764032:12345-192.168.203.13@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788864822.864983:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+6:8161:x1875760528764032:12345-192.168.203.13@tcp:40:mount.lustre.0 Request processed in 39us (5033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864822.864990:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:0.0:1788864822.872373:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864822.872864:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528764416 00000100:00100000:2.0:1788864822.872878:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528764416 00000100:00100000:2.0:1788864822.872951:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:2.0:1788864822.872964:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbba7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36a5d9c7-7504-4a4b-a03e-664186d01d07+6:8161:x1875760528764416:12345-192.168.203.13@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788864822.873540:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788864822.873664:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbba7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36a5d9c7-7504-4a4b-a03e-664186d01d07+6:8161:x1875760528764416:12345-192.168.203.13@tcp:33:mount.lustre.0 Request processed in 701us (1306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864822.873674:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:0.0:1788864822.874319:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864822.876558:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528764160 00000100:00100000:2.0:1788864822.876578:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528764160 00000100:00100000:2.0:1788864822.876654:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:2.0:1788864822.876664:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2355:x1875760528764160:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788864822.876733:0:8199:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 36a5d9c7-7504-4a4b-a03e-664186d01d07@192.168.203.13@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:2.0:1788864822.876772:0:8199:0:(genops.c:1384:class_connect()) connect: client 36a5d9c7-7504-4a4b-a03e-664186d01d07, cookie 0xf8c13e2d0e959284 00002000:00100000:2.0:1788864822.876804:0:8199:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 36a5d9c7-7504-4a4b-a03e-664186d01d07/ffff9fdcbfdf3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788864822.876838:0:8199:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788864822.877189:0:8199:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1788864822.877609:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864822.878374:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528764288 00000100:00100000:1.0:1788864822.878751:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528764288 00000100:00100000:1.0:1788864822.878814:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:1.0:1788864822.878825:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc063a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1875760528764288:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788864822.878866:0:6684:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 36a5d9c7-7504-4a4b-a03e-664186d01d07@192.168.203.13@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:1.0:1788864822.878925:0:6684:0:(genops.c:1384:class_connect()) connect: client 36a5d9c7-7504-4a4b-a03e-664186d01d07, cookie 0xf8c13e2d0e95928b 00002000:00100000:1.0:1788864822.878941:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 36a5d9c7-7504-4a4b-a03e-664186d01d07/ffff9fdcc0031800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788864822.878955:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788864822.880898:0:8199:0:(import.c:65:import_set_state_nolock()) ffff9fdcbfdf1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788864822.881043:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36a5d9c7-7504-4a4b-a03e-664186d01d07+6:2355:x1875760528764160:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 4373us (6722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864822.881056:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00002000:00080000:3.0:1788864822.883592:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788864822.883673:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9fdb824ab800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788864822.883794:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc063a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36a5d9c7-7504-4a4b-a03e-664186d01d07+6:2355:x1875760528764288:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 4967us (6186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864822.883808:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00010000:00010000:1.0:1788864823.878019:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788864824.202175:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 36a5d9c7-7504-4a4b-a03e-664186d01d07 00000001:00100000:1.0:1788864824.269176:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 36a5d9c7-7504-4a4b-a03e-664186d01d07 00010000:00010000:0.0:1788864824.905181:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864825.669006:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788864825.669029:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546621696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788864825.669108:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864825.669208:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546621696 00000100:00100000:2.0:1788864825.669216:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546621696 00000100:00080000:1.0:1788864825.669247:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788864825.669265:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788864825.669276:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546621696:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788864825.669307:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00002000:00000024:2.0:1788864825.669309:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788864825.669315:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1788864825.669365:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546621696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864825.669373:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1788864825.669455:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc9f45e680 x1875760546621696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864825.669487:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546621696:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788864825.924992:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864826.695426:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546621824:0@lo:400:kworker.0 00000100:00100000:1.0:1788864826.695576:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864826.695742:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546621952:0@lo:400:kworker.0 00000100:00100000:0.0:1788864826.695777:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864826.695824:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546622464:0@lo:400:kworker.0 00000100:00100000:0.0:1788864826.695847:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864826.695879:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788864826.695885:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546622080:0@lo:400:kworker.0 00000100:00100000:0.0:1788864826.695908:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864826.695939:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546622464 00000100:00100000:0.0:1788864826.695959:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546622464 00000100:00100000:0.0:1788864826.696015:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788864826.696025:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546622464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864826.697331:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546622208:0@lo:400:kworker.0 00000100:00100000:2.0:1788864826.697392:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864826.697426:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788864826.697432:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546622336:0@lo:400:kworker.0 00000100:00100000:2.0:1788864826.697473:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864826.697508:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546621952 00000100:00100000:2.0:1788864826.697515:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546621952 00000100:00100000:2.0:1788864826.697551:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546622080 00000100:00100000:2.0:1788864826.697554:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546622080 00000100:00100000:2.0:1788864826.697569:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546622336 00000100:00100000:2.0:1788864826.697572:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546622336 00000100:00100000:2.0:1788864826.697587:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788864826.697594:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546621952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864826.697647:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546621952:12345-0@lo:400:kworker.0 Request processed in 53us (1869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864826.697655:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788864826.697671:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788864826.697678:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546622080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864826.697728:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546622080:12345-0@lo:400:kworker.0 Request processed in 27us (1795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864826.697734:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788864826.697745:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788864826.697751:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546622336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864826.697781:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546622336:12345-0@lo:400:kworker.0 Request processed in 30us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864826.697786:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788864826.697802:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546622208 00000100:00100000:2.0:1788864826.697806:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546622208 00000100:00100000:2.0:1788864826.697828:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788864826.697834:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546622208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864826.697863:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546622208:12345-0@lo:400:kworker.0 Request processed in 30us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864826.697869:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788864826.697908:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546622336:0@lo:400:kworker.0 00010000:00080000:2.0:1788864826.697921:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcacbee680 x1875760546622208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864826.697931:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546622208:0@lo:400:kworker.0 00000100:00080000:2.0:1788864826.698003:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788864826.698008:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788864826.698041:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546622080:0@lo:400:kworker.0 00000100:00100000:2.0:1788864826.698052:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546621952:0@lo:400:kworker.0 00010000:00080000:2.0:1788864826.698064:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcacbedf80 x1875760546622464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864826.698073:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546622464:0@lo:400:kworker.0 00000100:00100000:0.0:1788864826.699184:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546622464:12345-0@lo:400:kworker.0 Request processed in 54us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864826.699196:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788864826.700537:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546621824 00000100:00100000:3.0:1788864826.700548:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546621824 00000100:00100000:3.0:1788864826.700825:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788864826.700834:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3301:x1875760546621824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864826.700921:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3301:x1875760546621824:12345-0@lo:400:kworker.0 Request processed in 88us (5344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864826.700928:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788864826.701011:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546621824:0@lo:400:kworker.0 00010000:00010000:0.0:1788864826.949065:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864827.204952:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788864827.204985:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546622592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788864827.205052:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864827.205267:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546622592 00000100:00100000:2.0:1788864827.205277:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546622592 00000100:00100000:2.0:1788864827.205333:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788864827.205343:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546622592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788864827.205377:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788864827.205431:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546622592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864827.205438:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788864827.205564:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc9f45e680 x1875760546622592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864827.205582:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546622592:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788864827.817043:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 36a5d9c7-7504-4a4b-a03e-664186d01d07 00010000:00010000:0.0:1788864827.975437:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864828.307998:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864828.308060:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864828.308105:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528764672 00000100:00100000:3.0:1788864828.308117:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528764672 00000100:00100000:3.0:1788864828.308208:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:3.0:1788864828.308220:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2357:x1875760528764672:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864828.308321:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2357:x1875760528764672:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 97us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864828.308330:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00080000:3.0:1788864828.308355:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788864828.309092:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528764544 00000100:00100000:1.0:1788864828.309100:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528764544 00000100:00100000:1.0:1788864828.309148:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 219 00000100:00100000:1.0:1788864828.309156:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:2357:x1875760528764544:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788864828.309202:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:2357:x1875760528764544:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 47us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864828.309209:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 219 00000100:00100000:1.0:1788864828.309265:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864828.309342:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864828.309391:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864828.309416:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528764800 00000100:00100000:1.0:1788864828.309421:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528764800 00000100:00100000:1.0:1788864828.309479:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:1.0:1788864828.309487:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528764800:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788864828.309523:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528764800:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 36us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864828.309529:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:1.0:1788864828.309551:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528765056 00000100:00100000:1.0:1788864828.309555:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528765056 00000100:00100000:1.0:1788864828.309582:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528764928 00000100:00100000:1.0:1788864828.309586:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528764928 00000100:00100000:1.0:1788864828.309610:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:1.0:1788864828.309617:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528765056:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788864828.309656:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528765056:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 39us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864828.309663:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:1.0:1788864828.309675:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:1.0:1788864828.309682:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528764928:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788864828.309726:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528764928:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 45us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864828.309732:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00080000:1.0:1788864828.309763:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788864828.309766:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788864828.309768:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788864829.004620:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788864829.194022:0:10303:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1788864830.020931:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864830.791771:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546622720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788864830.791901:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864830.792150:0:10234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546622720 00000100:00100000:2.0:1788864830.792161:0:10234:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546622720 00000100:00100000:2.0:1788864830.792246:0:10234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788864830.792257:0:10234:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546622720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788864830.792305:0:10234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788864830.792363:0:10234:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546622720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864830.792371:0:10234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788864830.792467:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788864830.792504:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc9f45f800 x1875760546622720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864830.792526:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546622720:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788864831.044910:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864831.813345:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546622848:0@lo:400:kworker.0 00000100:00100000:0.0:1788864831.813455:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864831.813516:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875760546623360:0@lo:400:kworker.0 00000100:00100000:0.0:1788864831.813547:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864831.813579:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788864831.813585:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546623232:0@lo:400:kworker.0 00000100:00100000:0.0:1788864831.813614:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864831.813650:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546622976:0@lo:400:kworker.0 00000100:00100000:0.0:1788864831.813675:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864831.813696:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546623488:0@lo:400:kworker.0 00000100:00100000:0.0:1788864831.813763:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864831.813783:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788864831.813789:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546623104:0@lo:400:kworker.0 00000100:00100000:0.0:1788864831.813813:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864831.813851:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546622848 00000100:00100000:0.0:1788864831.813860:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546622848 00000100:00100000:0.0:1788864831.813915:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788864831.813925:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3301:x1875760546622848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864831.814183:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3301:x1875760546622848:12345-0@lo:400:kworker.0 Request processed in 258us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864831.814191:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788864831.814232:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546623360 00000100:00100000:0.0:1788864831.814237:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546623360 00000100:00100000:0.0:1788864831.814275:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546622976 00000100:00100000:0.0:1788864831.814278:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546622976 00000100:00100000:0.0:1788864831.814393:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546623104 00000100:00100000:0.0:1788864831.814397:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546623104 00000100:00100000:0.0:1788864831.814416:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788864831.814423:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875760546623360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864831.814472:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875760546623360:12345-0@lo:400:kworker.0 Request processed in 50us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864831.814479:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788864831.814492:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788864831.814498:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546622976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864831.814528:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546622976:12345-0@lo:400:kworker.0 Request processed in 31us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864831.814534:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788864831.814556:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788864831.814562:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546623104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864831.814590:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546623104:12345-0@lo:400:kworker.0 Request processed in 28us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864831.814596:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788864831.814616:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546623232 00000100:00100000:0.0:1788864831.814620:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546623232 00000100:00100000:0.0:1788864831.814646:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546623488 00000100:00100000:0.0:1788864831.814649:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546623488 00000100:00100000:0.0:1788864831.814672:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788864831.814679:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546623232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864831.814738:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546623232:12345-0@lo:400:kworker.0 Request processed in 59us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864831.814745:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788864831.814757:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788864831.814763:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546623488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864831.814793:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546623488:12345-0@lo:400:kworker.0 Request processed in 30us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864831.814799:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1788864831.814834:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788864831.814839:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788864831.814884:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546623104:0@lo:400:kworker.0 00000100:00100000:0.0:1788864831.814896:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546622976:0@lo:400:kworker.0 00010000:00080000:0.0:1788864831.814909:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcacbee680 x1875760546623488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864831.814920:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546623488:0@lo:400:kworker.0 00010000:00080000:0.0:1788864831.816563:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcacbeea00 x1875760546623232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864831.816582:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546623232:0@lo:400:kworker.0 00000100:00100000:0.0:1788864831.816595:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546622848:0@lo:400:kworker.0 00000100:00100000:0.0:1788864831.816610:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875760546623360:0@lo:400:kworker.0 00010000:00010000:1.0:1788864832.074215:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864832.325845:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788864832.325866:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546623616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788864832.325941:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864832.326010:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546623616 00000100:00100000:0.0:1788864832.326018:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546623616 00000100:00100000:0.0:1788864832.326063:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788864832.326073:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546623616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788864832.326106:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788864832.326148:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546623616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864832.326155:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788864832.326193:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdca003c380 x1875760546623616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864832.326211:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546623616:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788864833.093785:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864833.432014:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864833.434842:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864833.434881:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864833.434904:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864833.435010:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528765440 00000100:00100000:3.0:1788864833.435020:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528765440 00000100:00100000:3.0:1788864833.435089:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528765312 00000100:00100000:3.0:1788864833.435094:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528765312 00000100:00100000:3.0:1788864833.435118:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:3.0:1788864833.435128:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2357:x1875760528765440:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864833.435198:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2357:x1875760528765440:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 71us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864833.435205:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:3.0:1788864833.435221:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:3.0:1788864833.435227:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2357:x1875760528765312:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864833.435250:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2357:x1875760528765312:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 23us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864833.435255:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00080000:3.0:1788864833.435272:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788864833.435374:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864833.435624:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528765696 00000100:00100000:3.0:1788864833.435628:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528765696 00000100:00100000:3.0:1788864833.435660:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528765568 00000100:00100000:3.0:1788864833.435663:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528765568 00000100:00100000:3.0:1788864833.435683:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:3.0:1788864833.435691:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2357:x1875760528765696:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864833.435737:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2357:x1875760528765696:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 47us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864833.435744:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:3.0:1788864833.435756:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:3.0:1788864833.435762:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2357:x1875760528765568:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864833.435785:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2357:x1875760528765568:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 23us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864833.435798:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00080000:3.0:1788864833.435820:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788864833.435824:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788864833.439183:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528765184 00000100:00100000:2.0:1788864833.439198:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528765184 00000100:00100000:2.0:1788864833.439274:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 221 00000100:00100000:2.0:1788864833.439284:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+13:2357:x1875760528765184:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788864833.439360:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+13:2357:x1875760528765184:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 77us (7355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864833.439367:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 221 00010000:00010000:1.0:1788864834.116932:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864835.141011:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864835.910036:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788864835.910061:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546623744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788864835.910124:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864835.910255:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546623744 00000100:00100000:1.0:1788864835.910265:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546623744 00000100:00080000:3.0:1788864835.910295:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788864835.910389:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788864835.910414:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546623744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788864835.910449:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788864835.910514:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546623744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864835.910523:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1788864835.910669:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc9f45c700 x1875760546623744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864835.910698:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546623744:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788864836.164875:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864836.932922:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546623872:0@lo:400:kworker.0 00000100:00100000:1.0:1788864836.932990:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864836.933166:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546624256:0@lo:400:kworker.0 00000100:00100000:3.0:1788864836.933203:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864836.933238:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546624256 00000100:00100000:3.0:1788864836.933245:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546624256 00000100:00100000:3.0:1788864836.933296:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788864836.933305:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546624256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864836.933352:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546624256:12345-0@lo:400:kworker.0 Request processed in 48us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864836.933358:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788864836.933525:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcacbeed80 x1875760546624256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864836.933538:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546624256:0@lo:400:kworker.0 00000100:00100000:1.0:1788864836.934781:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546624000:0@lo:400:kworker.0 00000100:00100000:1.0:1788864836.934831:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864836.934872:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788864836.934879:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546624128:0@lo:400:kworker.0 00000100:00100000:2.0:1788864836.934902:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546624000 00000100:00100000:1.0:1788864836.934904:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864836.934909:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546624000 00000100:00100000:1.0:1788864836.934932:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546623872 00000100:00100000:1.0:1788864836.934936:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546623872 00000100:00100000:2.0:1788864836.934944:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546624128 00000100:00100000:2.0:1788864836.934946:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546624128 00000100:00100000:1.0:1788864836.934962:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788864836.934969:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3301:x1875760546623872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864836.934970:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788864836.934976:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546624000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864836.935010:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546624000:12345-0@lo:400:kworker.0 Request processed in 33us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864836.935010:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3301:x1875760546623872:12345-0@lo:400:kworker.0 Request processed in 41us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864836.935017:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788864836.935025:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788864836.935044:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788864836.935049:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546624128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864836.935084:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546624128:0@lo:400:kworker.0 00000100:00100000:0.0:1788864836.936374:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788864836.936387:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546624512:0@lo:400:kworker.0 00000100:00100000:1.0:1788864836.936823:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546624000:0@lo:400:kworker.0 00000100:00100000:1.0:1788864836.936856:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875760546624384:0@lo:400:kworker.0 00000100:00100000:2.0:1788864836.936913:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546624128:12345-0@lo:400:kworker.0 Request processed in 1862us (2006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864836.936922:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788864836.936927:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864836.936943:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546624384 00000100:00100000:2.0:1788864836.936954:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546624384 00000100:00100000:1.0:1788864836.936954:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546623872:0@lo:400:kworker.0 00000100:00100000:2.0:1788864836.936995:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788864836.937003:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875760546624384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864836.937053:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864836.937058:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875760546624384:12345-0@lo:400:kworker.0 Request processed in 57us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864836.937064:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788864836.937081:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546624512 00000100:00080000:2.0:1788864836.937083:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788864836.937085:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546624512 00000100:00100000:1.0:1788864836.937161:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875760546624384:0@lo:400:kworker.0 00000100:00080000:1.0:1788864836.937182:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788864836.937241:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788864836.937262:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546624512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864836.937305:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546624512:12345-0@lo:400:kworker.0 Request processed in 58us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864836.937311:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1788864836.937364:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcacbee680 x1875760546624512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864836.937374:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546624512:0@lo:400:kworker.0 00010000:00010000:3.0:1788864837.188975:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864837.446503:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546624640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788864837.446583:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864837.446673:0:10234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546624640 00000100:00100000:3.0:1788864837.446681:0:10234:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546624640 00000100:00100000:3.0:1788864837.446808:0:10234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788864837.446818:0:10234:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546624640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788864837.446853:0:10234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788864837.446896:0:10234:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546624640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864837.446908:0:10234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788864837.446945:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc9f45c700 x1875760546624640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864837.446962:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546624640:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788864838.212889:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864838.545206:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864838.545262:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864838.545315:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864838.545320:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528766208 00000100:00100000:3.0:1788864838.545334:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528766208 00000100:00100000:1.0:1788864838.545353:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864838.545399:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864838.545432:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528766336 00000100:00100000:1.0:1788864838.545432:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528765952 00000100:00100000:3.0:1788864838.545439:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528766336 00000100:00100000:1.0:1788864838.545439:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528765952 00000100:00100000:3.0:1788864838.545480:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:1.0:1788864838.545488:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528766080 00000100:00100000:1.0:1788864838.545493:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528766080 00000100:00100000:3.0:1788864838.545495:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528766208:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788864838.545525:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:1.0:1788864838.545535:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2358:x1875760528765952:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788864838.545626:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528765824 00000100:00100000:0.0:1788864838.545631:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528765824 00000100:00100000:0.0:1788864838.545667:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 223 00000100:00100000:0.0:1788864838.545674:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+13:2358:x1875760528765824:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788864838.545724:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:2.0:1788864838.545736:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528766080:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864838.545764:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528766208:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 271us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864838.545773:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:3.0:1788864838.545795:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:3.0:1788864838.545803:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528766336:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788864838.550809:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2358:x1875760528765952:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 5257us (5599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864838.550976:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+13:2358:x1875760528765824:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 5298us (5657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864838.550991:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 223 00000100:00100000:1.0:1788864838.551555:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00080000:1.0:1788864838.551596:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788864838.551603:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788864838.551607:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788864838.554279:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528766080:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 8530us (8910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864838.554298:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:3.0:1788864838.559410:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528766336:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 13577us (13980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864838.559430:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00010000:00010000:1.0:1788864839.237938:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864840.262425:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864841.031338:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546624768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788864841.031420:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864841.032698:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546624768 00000100:00100000:0.0:1788864841.032720:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546624768 00000100:00100000:0.0:1788864841.032895:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788864841.032906:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546624768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788864841.033000:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788864841.033082:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546624768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 179us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864841.033089:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788864841.033209:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcacbedf80 x1875760546624768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864841.033230:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546624768:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788864841.034930:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788864841.287745:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864842.053000:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcafcce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546625024:0@lo:400:kworker.0 00000100:00100000:2.0:1788864842.053073:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864842.053174:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcafcce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546624896:0@lo:400:kworker.0 00000100:00100000:3.0:1788864842.053209:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864842.053265:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546624896 00000100:00100000:3.0:1788864842.053272:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546624896 00000100:00100000:3.0:1788864842.053312:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788864842.053320:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3301:x1875760546624896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864842.053374:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3301:x1875760546624896:12345-0@lo:400:kworker.0 Request processed in 54us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864842.053381:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788864842.053430:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcafcce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546624896:0@lo:400:kworker.0 00000100:00100000:3.0:1788864842.053464:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546625024 00000100:00100000:3.0:1788864842.053467:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546625024 00000100:00100000:3.0:1788864842.053510:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788864842.053516:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546625024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864842.053786:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875760546625152:0@lo:400:kworker.0 00000100:00100000:1.0:1788864842.053814:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864842.053843:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546625152 00000100:00100000:1.0:1788864842.053847:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546625152 00000100:00100000:1.0:1788864842.053879:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788864842.053886:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875760546625152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864842.053919:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875760546625152:12345-0@lo:400:kworker.0 Request processed in 33us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864842.053924:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788864842.053939:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788864842.053958:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875760546625152:0@lo:400:kworker.0 00000100:00100000:3.0:1788864842.056826:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546625024:12345-0@lo:400:kworker.0 Request processed in 3300us (3743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864842.056827:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcafcce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546625024:0@lo:400:kworker.0 00000100:00100000:3.0:1788864842.056845:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788864842.057121:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546625280:0@lo:400:kworker.0 00000100:00100000:3.0:1788864842.057172:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864842.057243:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546625280 00000100:00100000:1.0:1788864842.057250:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546625280 00000100:00100000:1.0:1788864842.057299:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788864842.057308:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546625280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864842.057496:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546625280:12345-0@lo:400:kworker.0 Request processed in 189us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864842.057503:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1788864842.057749:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcacbee680 x1875760546625280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864842.057761:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546625280:0@lo:400:kworker.0 00000100:00100000:3.0:1788864842.057773:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788864842.057778:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546625408:0@lo:400:kworker.0 00000100:00100000:3.0:1788864842.057803:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864842.057888:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546625408 00000100:00100000:1.0:1788864842.057892:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546625408 00000100:00100000:1.0:1788864842.057976:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788864842.057983:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546625408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864842.058019:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546625408:12345-0@lo:400:kworker.0 Request processed in 37us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864842.058025:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788864842.058048:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546625408:0@lo:400:kworker.0 00000100:00100000:1.0:1788864842.058273:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546625536:0@lo:400:kworker.0 00000100:00100000:1.0:1788864842.058299:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864842.058353:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546625536 00000100:00100000:3.0:1788864842.058366:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546625536 00000100:00080000:2.0:1788864842.058394:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788864842.058635:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788864842.058649:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546625536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864842.058843:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546625536:12345-0@lo:400:kworker.0 Request processed in 195us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864842.058850:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1788864842.058867:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788864842.058910:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcacbed500 x1875760546625536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864842.058920:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546625536:0@lo:400:kworker.0 00010000:00010000:0.0:1788864842.309430:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864842.564981:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788864842.565003:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546625664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788864842.565066:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864842.565588:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546625664 00000100:00100000:1.0:1788864842.565597:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546625664 00000100:00100000:1.0:1788864842.565652:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788864842.565661:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546625664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788864842.565696:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788864842.565766:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546625664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864842.565773:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788864842.565883:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc9f45c700 x1875760546625664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864842.565902:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546625664:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788864843.333097:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864843.666051:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864843.666091:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864843.666120:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864843.666146:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864843.666173:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528766848 00000100:00100000:1.0:1788864843.666188:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528766848 00000100:00100000:1.0:1788864843.666359:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528766976 00000100:00100000:1.0:1788864843.666364:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528766976 00000100:00100000:1.0:1788864843.666392:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:1.0:1788864843.666403:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2355:x1875760528766848:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:1.0:1788864843.666433:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e959284 00000100:00080000:1.0:1788864843.666444:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9fdcbfdf1800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788864843.666480:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788864843.666843:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36a5d9c7-7504-4a4b-a03e-664186d01d07+2:2355:x1875760528766848:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 441us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864843.666850:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:1.0:1788864843.666866:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:1.0:1788864843.666874:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2355:x1875760528766976:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:1.0:1788864843.666886:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e95928b 00000100:00080000:1.0:1788864843.666892:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9fdb824ab800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788864843.666911:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788864843.667731:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36a5d9c7-7504-4a4b-a03e-664186d01d07+2:2355:x1875760528766976:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 828us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864843.667740:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:1.0:1788864843.667763:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528766464 00000100:00100000:1.0:1788864843.667768:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528766464 00000100:00100000:1.0:1788864843.667798:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 225 00000100:00100000:1.0:1788864843.667806:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:2358:x1875760528766464:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788864843.667833:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:2358:x1875760528766464:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 28us (1711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864843.667840:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 225 00000100:00100000:1.0:1788864843.667889:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528766720 00000100:00100000:1.0:1788864843.667894:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528766720 00000100:00100000:1.0:1788864843.667923:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:1.0:1788864843.667930:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528766720:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788864843.667975:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528766720:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 46us (1828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864843.667982:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00080000:1.0:1788864843.667997:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788864843.668001:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788864843.668003:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788864843.668016:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864843.668126:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864843.672983:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864843.674994:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528766592 00000100:00100000:3.0:1788864843.675007:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528766592 00000100:00100000:3.0:1788864843.675079:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:3.0:1788864843.675089:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2359:x1875760528766592:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864843.675167:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2359:x1875760528766592:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 79us (2191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864843.675175:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00080000:1.0:1788864843.675243:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788864844.357936:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788864844.678256:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 36a5d9c7-7504-4a4b-a03e-664186d01d07 00000020:00000080:0.0:1788864844.678266:0:7636:0:(genops.c:885:class_export_put()) final put ffff9fdcc0031800/36a5d9c7-7504-4a4b-a03e-664186d01d07 00000020:00000080:0.0:1788864844.678293:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcc0031800/36a5d9c7-7504-4a4b-a03e-664186d01d07 for lustre-OST0001 00000020:00000080:0.0:1788864844.678350:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fdb824ab800 for lustre-OST0001 00000001:02000400:0.0:1788864844.994436:0:11004:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788864845.381004:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864846.149054:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546625792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788864846.149137:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864846.151537:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546625792 00000100:00100000:0.0:1788864846.151552:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546625792 00000100:00100000:0.0:1788864846.151648:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788864846.151658:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546625792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788864846.151695:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788864846.151804:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546625792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (2665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864846.151812:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788864846.151921:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788864846.151964:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcacbeed80 x1875760546625792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864846.151983:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546625792:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788864846.407685:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864847.172936:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546625920:0@lo:400:kworker.0 00000100:00100000:2.0:1788864847.173015:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864847.173514:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546625920 00000100:00100000:1.0:1788864847.173524:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546625920 00000100:00100000:1.0:1788864847.173630:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788864847.173640:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3301:x1875760546625920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864847.173698:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3301:x1875760546625920:12345-0@lo:400:kworker.0 Request processed in 60us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864847.173739:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788864847.176107:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546626304:0@lo:400:kworker.0 00000100:00100000:3.0:1788864847.176176:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864847.176213:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788864847.176218:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546626432:0@lo:400:kworker.0 00000100:00100000:3.0:1788864847.176281:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864847.176439:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875760546626176:0@lo:400:kworker.0 00000100:00100000:3.0:1788864847.176468:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864847.176502:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788864847.176508:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875760546626048:0@lo:400:kworker.0 00000100:00100000:3.0:1788864847.176531:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864847.176544:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546626304 00000100:00100000:3.0:1788864847.176549:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546626560:0@lo:400:kworker.0 00000100:00100000:0.0:1788864847.176553:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546626304 00000100:00100000:0.0:1788864847.176701:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788864847.176730:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546626304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864847.176786:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546626304:12345-0@lo:400:kworker.0 Request processed in 59us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864847.176794:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788864847.178786:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546626432 00000100:00100000:3.0:1788864847.178791:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864847.178797:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546626432 00000100:00100000:3.0:1788864847.178837:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546626176 00000100:00100000:3.0:1788864847.178841:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546626176 00000100:00100000:1.0:1788864847.178858:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546626048 00000100:00100000:1.0:1788864847.178861:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546626048 00000100:00100000:3.0:1788864847.178863:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788864847.178871:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546626432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864847.178873:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788864847.178878:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875760546626176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864847.178917:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546626432:12345-0@lo:400:kworker.0 Request processed in 47us (2635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864847.178920:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875760546626176:12345-0@lo:400:kworker.0 Request processed in 41us (2451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864847.178924:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788864847.181987:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788864847.182000:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788864847.182087:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875760546626048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864847.182180:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875760546626048:12345-0@lo:400:kworker.0 Request processed in 102us (5647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864847.182187:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788864847.182264:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546626432:0@lo:400:kworker.0 00010000:00080000:3.0:1788864847.182281:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcacbeea00 x1875760546626304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864847.182298:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546626304:0@lo:400:kworker.0 00000100:00100000:3.0:1788864847.182341:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546626560 00000100:00100000:3.0:1788864847.182348:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546626560 00000100:00100000:3.0:1788864847.182396:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788864847.182403:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546626560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864847.182445:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546626560:12345-0@lo:400:kworker.0 Request processed in 43us (3657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864847.182451:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788864847.182468:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788864847.182472:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864847.182492:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875760546626048:0@lo:400:kworker.0 00010000:00080000:3.0:1788864847.182516:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcacbedf80 x1875760546626560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864847.182526:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546626560:0@lo:400:kworker.0 00000100:00100000:3.0:1788864847.182538:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875760546626176:0@lo:400:kworker.0 00000100:00100000:3.0:1788864847.182587:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546625920:0@lo:400:kworker.0 00010000:00010000:1.0:1788864847.430891:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864847.686800:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546626688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788864847.686875:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864847.687016:0:10234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546626688 00000100:00100000:3.0:1788864847.687025:0:10234:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546626688 00000100:00100000:3.0:1788864847.687073:0:10234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788864847.687083:0:10234:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546626688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788864847.687115:0:10234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788864847.687167:0:10234:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546626688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864847.687173:0:10234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788864847.687233:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcbc827b80 x1875760546626688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864847.687259:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546626688:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788864848.263586:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 36a5d9c7-7504-4a4b-a03e-664186d01d07 00000020:00000080:1.0:1788864848.263596:0:6709:0:(genops.c:885:class_export_put()) final put ffff9fdcbfdf3800/36a5d9c7-7504-4a4b-a03e-664186d01d07 00000020:00000080:2.0:1788864848.263918:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcbfdf3800/36a5d9c7-7504-4a4b-a03e-664186d01d07 for lustre-OST0000 00000020:00000080:2.0:1788864848.263992:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fdcbfdf1800 for lustre-OST0000 00000020:00000080:2.0:1788864848.436206:0:11153:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffca283d60 20000000:00000080:2.0:1788864848.436225:0:11153:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fdcc00b9400 uarg=0000000000000000 20000000:01000000:2.0:1788864848.436259:0:11153:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788864848.436264:0:11153:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788864848.436267:0:11153:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788864848.438983:0:11154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788864848.439122:0:11153:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788864848.447081:0:11153:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788864848.447112:0:11153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e959292 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864848.447133:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdb8213ec00/0xf8c13e2d0e959237 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa31 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864848.447157:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959245 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95923e expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864848.447165:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdcc2045e00/0xf8c13e2d0e959253 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95924c expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864848.447172:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdcc2045600/0xf8c13e2d0e959261 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95925a expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864848.447180:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdcb5385400/0xf8c13e2d0e959276 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa69 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864848.447188:0:11153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e959292 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864848.447229:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdcb5385400/0xf8c13e2d0e959276 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa69 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864848.447244:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fdcb5385400/0xf8c13e2d0e959276 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa69 expref: 12 pid: 5830 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864848.447260:0:11153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc824a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875760546626816:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788864848.447379:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdcc2045600/0xf8c13e2d0e959261 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e95925a expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864848.447388:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fdcc2045600/0xf8c13e2d0e959261 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e95925a expref: 18 pid: 5828 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864848.447397:0:11153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc825880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875760546626944:0@lo:104: 00000100:00100000:3.0:1788864848.447447:0:11153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788864848.447916:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdcc2045e00/0xf8c13e2d0e959253 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e95924c expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864848.447926:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fdcc2045e00/0xf8c13e2d0e959253 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e95924c expref: 18 pid: 5827 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864848.447935:0:11153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc825180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875760546627072:0@lo:104: 00000100:00100000:3.0:1788864848.447959:0:11153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788864848.447980:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e95923e expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864848.447988:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959245 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e95923e expref: 18 pid: 5827 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864848.447996:0:11153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc824380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875760546627200:0@lo:104: 00000100:00100000:3.0:1788864848.448014:0:11153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788864848.448029:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdb8213ec00/0xf8c13e2d0e959237 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa31 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864848.448038:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fdb8213ec00/0xf8c13e2d0e959237 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa31 expref: 12 pid: 5830 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864848.448047:0:11153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc827b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875760546627328:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788864848.448077:0:11153:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598540 going to sleep for 11 seconds 00000100:00100000:2.0:1788864848.448158:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546626944 00000100:00100000:2.0:1788864848.448166:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546626944 00000100:00100000:2.0:1788864848.448204:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546627072 00000100:00100000:2.0:1788864848.448207:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546627072 00000100:00100000:2.0:1788864848.448220:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546627200 00000100:00100000:2.0:1788864848.448223:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546627200 00000100:00100000:2.0:1788864848.448237:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788864848.448247:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc824000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+5:11153:x1875760546626944:12345-0@lo:104: 00010000:00010000:2.0:1788864848.448259:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044000/0xf8c13e2d0e95925a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e959261 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.448331:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788864848.448337:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc824000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+5:11153:x1875760546626944:12345-0@lo:104: Request processed in 92us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864848.448343:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788864848.448358:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788864848.448364:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc827100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+4:11153:x1875760546627072:12345-0@lo:104: 00010000:00010000:2.0:1788864848.448371:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e95924c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e959253 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.448402:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788864848.448414:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc827100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+4:11153:x1875760546627072:12345-0@lo:104: Request processed in 51us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864848.448421:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788864848.448433:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788864848.448439:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc826d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+3:11153:x1875760546627200:12345-0@lo:104: 00010000:00010000:2.0:1788864848.448446:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95923e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e959245 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.448494:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788864848.448500:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc826d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+3:11153:x1875760546627200:12345-0@lo:104: Request processed in 61us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864848.448505:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788864848.448525:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788864848.448530:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044000/0xf8c13e2d0e95925a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e959261 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.448537:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc2044000 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1788864848.448542:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044000/0xf8c13e2d0e95925a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e959261 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.448549:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044000/0xf8c13e2d0e95925a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e959261 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788864848.448556:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044000/0xf8c13e2d0e95925a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e959261 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864848.448562:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788864848.448588:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788864848.448591:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044000/0xf8c13e2d0e95925a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959261 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.448607:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788864848.448626:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044000/0xf8c13e2d0e95925a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959261 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.448632:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044000/0xf8c13e2d0e95925a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959261 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.448648:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864848.448651:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95923e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e959245 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.448657:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213ea00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1788864848.448661:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95923e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e959245 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.448668:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95923e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e959245 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788864848.448675:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95923e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e959245 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864848.448681:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788864848.448697:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95923e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959245 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.448737:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788864848.448743:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95923e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959245 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.448750:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdb8213ea00/0xf8c13e2d0e95923e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959245 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.448766:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864848.448768:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864848.448769:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864848.449076:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864848.449079:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864848.449081:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864848.449281:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e95924c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e959253 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.449291:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc2044600 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1788864848.449295:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e95924c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e959253 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.449303:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e95924c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e959253 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788864848.449310:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e95924c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e959253 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864848.449327:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788864848.449351:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e95924c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959253 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.449357:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788864848.449375:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e95924c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959253 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.449381:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044600/0xf8c13e2d0e95924c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e959253 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.449395:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864848.449397:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864848.449405:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864848.449418:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546627712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788864848.449458:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864848.449519:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546627712 00000100:00100000:2.0:1788864848.449524:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546627712 00010000:00010000:2.0:1788864848.449542:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdcc2045e00/0xf8c13e2d0e959253 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95924c expref: 19 pid: 5827 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864848.449564:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788864848.449572:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3302:x1875760546627712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788864848.449582:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864848.449587:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdcc2045e00/0xf8c13e2d0e959253 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95924c expref: 19 pid: 5827 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.449597:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdcc2045e00/0xf8c13e2d0e959253 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e95924c expref: 19 pid: 5827 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.449611:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864848.449652:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3302:x1875760546627712:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864848.449659:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788864848.449750:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546627712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788864848.451996:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546627456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788864848.452100:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864848.452148:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788864848.452155:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546627584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788864848.452199:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864848.452241:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546627456 00000100:00100000:3.0:1788864848.452249:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546627456 00010000:00010000:3.0:1788864848.452279:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdcc2045600/0xf8c13e2d0e959261 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95925a expref: 19 pid: 5828 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864848.452311:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546627584 00000100:00100000:3.0:1788864848.452324:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546627584 00010000:00010000:3.0:1788864848.452336:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959245 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95923e expref: 20 pid: 5827 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864848.452350:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788864848.452358:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbba7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+20:3300:x1875760546627456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788864848.452369:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864848.452374:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdcc2045600/0xf8c13e2d0e959261 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95925a expref: 20 pid: 5828 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864848.452384:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdcc2045600/0xf8c13e2d0e959261 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e95925a expref: 20 pid: 5828 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864848.452401:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788864848.452433:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbba7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+20:3300:x1875760546627456:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864848.452440:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788864848.452466:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788864848.452474:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbba7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3300:x1875760546627584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788864848.452481:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864848.452485:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959245 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95923e expref: 19 pid: 5827 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864848.452504:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959245 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e95923e expref: 19 pid: 5827 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864848.452515:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788864848.452537:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbba7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3300:x1875760546627584:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864848.452545:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788864848.452584:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546627584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788864848.452594:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546627456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788864848.452634:0:11153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc824a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875760546626816:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788864848.452645:0:11153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcc2045600/0xf8c13e2d0e959261 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e95925a expref: 18 pid: 5828 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864848.452656:0:11153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc825880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875760546626944:0@lo:104: 00010000:00010000:3.0:1788864848.452666:0:11153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcc2045e00/0xf8c13e2d0e959253 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e95924c expref: 17 pid: 5827 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864848.452673:0:11153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc825180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875760546627072:0@lo:104: 00010000:00010000:3.0:1788864848.452681:0:11153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcc2044e00/0xf8c13e2d0e959245 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e95923e expref: 16 pid: 5827 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864848.452690:0:11153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc824380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875760546627200:0@lo:104: 00000100:00100000:3.0:1788864848.452698:0:11153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc827b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875760546627328:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788864848.452741:0:11153:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e959292 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.453843:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864848.454298:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864848.455102:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528767104 00000100:00100000:2.0:1788864848.455114:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528767104 00010000:00010000:2.0:1788864848.455149:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdcb5385400/0xf8c13e2d0e959276 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa69 expref: 13 pid: 5830 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864848.455182:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:2.0:1788864848.455202:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafccca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:202cc404-00bb-4314-9125-b9b0b45f494c+13:2358:x1875760528767104:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788864848.455215:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864848.455221:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdcb5385400/0xf8c13e2d0e959276 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa69 expref: 13 pid: 5830 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.455233:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdcb5385400/0xf8c13e2d0e959276 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa69 expref: 13 pid: 5830 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.455249:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcb5385400/0xf8c13e2d0e959276 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa69 expref: 13 pid: 5830 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.455263:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864848.456656:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafccca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:202cc404-00bb-4314-9125-b9b0b45f494c+12:2358:x1875760528767104:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 1447us (2354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864848.456669:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:3.0:1788864848.462198:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864848.462368:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528767232 00000100:00100000:2.0:1788864848.462378:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528767232 00010000:00010000:2.0:1788864848.462415:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdb8213ec00/0xf8c13e2d0e959237 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa31 expref: 12 pid: 5830 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864848.462451:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:2.0:1788864848.462461:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbba7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:202cc404-00bb-4314-9125-b9b0b45f494c+12:2359:x1875760528767232:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788864848.462476:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864848.462481:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdb8213ec00/0xf8c13e2d0e959237 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa31 expref: 12 pid: 5830 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.462492:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdb8213ec00/0xf8c13e2d0e959237 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa31 expref: 12 pid: 5830 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.462526:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdb8213ec00/0xf8c13e2d0e959237 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa31 expref: 12 pid: 5830 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.462543:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e959292 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.462551:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e959292 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.462568:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e959292 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.462576:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e959292 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.462583:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e959292 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.462590:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e959292 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.462596:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213e400 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:2.0:1788864848.462600:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e959292 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.462607:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e959292 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.462624:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e959292 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864848.462643:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864848.462684:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbba7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:202cc404-00bb-4314-9125-b9b0b45f494c+11:2359:x1875760528767232:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 224us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864848.462691:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00010000:00010000:3.0:1788864848.463301:0:11153:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e959292 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864848.463324:0:11153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e959292 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864848.463331:0:11153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e959292 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864848.805258:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864848.805307:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864848.805374:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864848.805476:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528767488 00000100:00100000:2.0:1788864848.805486:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528767488 00000100:00100000:2.0:1788864848.805552:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528767616 00000100:00100000:2.0:1788864848.805556:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528767616 00000100:00100000:2.0:1788864848.805582:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:2.0:1788864848.805592:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2358:x1875760528767488:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788864848.805662:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2358:x1875760528767488:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 71us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864848.805670:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:2.0:1788864848.805688:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:2.0:1788864848.805695:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528767616:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788864848.805750:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528767616:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 55us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864848.805757:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00080000:1.0:1788864848.805987:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864848.806094:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528767360 00000100:00100000:3.0:1788864848.806099:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528767360 00000100:00100000:3.0:1788864848.806137:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 227 00000100:00100000:3.0:1788864848.806145:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+11:2358:x1875760528767360:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864848.806185:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+11:2358:x1875760528767360:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 40us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864848.806192:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 227 00010000:00010000:1.0:1788864849.477086:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788864849.861754:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788864849.861761:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fdcbfd92000 from 7 10000000:01000000:1.0:1788864849.861766:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788864849.861806:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14800/0xf8c13e2d0e959299 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864849.861819:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14800/0xf8c13e2d0e959299 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864849.861830:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14800/0xf8c13e2d0e959299 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864849.861854:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546627840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788864849.861923:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864849.863055:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc92fee780 going to sleep for 11 seconds 00000100:00100000:3.0:1788864849.865681:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546627840 00000100:00100000:3.0:1788864849.865695:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546627840 00000100:00100000:1.0:1788864849.865945:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788864849.865955:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:5832:x1875760546627840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788864849.865972:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864849.865992:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdca4d14e00/0xf8c13e2d0e9592a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e959299 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864849.866018:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdca4d14e00/0xf8c13e2d0e9592a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e959299 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864849.866030:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdca4d14e00/0xf8c13e2d0e9592a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e959299 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864849.866039:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca4d14e00, rc 0) 00000100:00100000:1.0:1788864849.866116:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546627840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (4193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864849.866123:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788864849.866580:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546627840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788864849.866609:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14800/0xf8c13e2d0e959299 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9592a0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864849.866619:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14800/0xf8c13e2d0e959299 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e9592a0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864849.866694:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546627968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788864849.866758:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864849.866788:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbff68b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788864849.866949:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546627968 00000100:00100000:1.0:1788864849.866954:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546627968 00000100:00100000:1.0:1788864849.866986:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788864849.866993:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546627968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788864849.867655:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546627968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 661us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864849.867665:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788864849.868466:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546627968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788864849.868594:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546628096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788864849.868644:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864849.868677:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbff68b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788864849.869123:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546628096 00000100:00100000:0.0:1788864849.869129:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546628096 00000100:00100000:0.0:1788864849.869178:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788864849.869187:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546628096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788864849.869665:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546628096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 478us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864849.869673:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788864849.869799:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546628096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788864849.870913:0:11192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788864849.870964:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788864849.870984:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788864849.870994:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14800/0xf8c13e2d0e959299 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9592a0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864849.871006:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14800/0xf8c13e2d0e959299 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9592a0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864849.871016:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788864849.871019:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fdcacbf0000 from 7 10000000:01000000:2.0:1788864849.871022:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788864849.871051:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385800/0xf8c13e2d0e9592a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864849.871059:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385800/0xf8c13e2d0e9592a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864849.871069:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385800/0xf8c13e2d0e9592a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864849.871098:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546628224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788864849.871145:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864849.871310:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbff68b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788864849.871379:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546628224 00000100:00100000:1.0:1788864849.871385:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546628224 00000100:00100000:1.0:1788864849.871473:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788864849.871482:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546628224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788864849.871493:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864849.871505:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdca4d14200/0xf8c13e2d0e9592ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e9592a7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864849.871526:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdca4d14200/0xf8c13e2d0e9592ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e9592a7 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864849.871537:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdca4d14200/0xf8c13e2d0e9592ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e9592a7 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864849.871545:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca4d14200, rc 0) 00000100:00100000:1.0:1788864849.871587:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546628224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864849.871593:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788864849.871652:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546628224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788864849.871665:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385800/0xf8c13e2d0e9592a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9592ae expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864849.871673:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385800/0xf8c13e2d0e9592a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e9592ae expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864849.871736:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546628352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788864849.871762:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864849.872134:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbff68b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788864849.872189:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546628352 00000100:00100000:0.0:1788864849.872202:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546628352 00000100:00100000:0.0:1788864849.872223:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788864849.872231:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546628352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788864849.872630:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546628352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 398us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864849.872637:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788864849.872694:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546628352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788864849.872812:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546628480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788864849.872850:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864849.872903:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbff68b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788864849.872946:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546628480 00000100:00100000:1.0:1788864849.872951:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546628480 00000100:00100000:0.0:1788864849.872996:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788864849.873003:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546628480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788864849.873149:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546628480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864849.873156:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788864849.873338:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546628480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788864849.874159:0:11194:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788864849.874611:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788864849.874628:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788864849.874637:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385800/0xf8c13e2d0e9592a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9592ae expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864849.874648:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385800/0xf8c13e2d0e9592a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9592ae expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864849.874658:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788864849.874660:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fdc8878e000 from 7 10000000:01000000:0.0:1788864849.874662:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788864849.874695:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e9592b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864849.874906:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e9592b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864849.874917:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e9592b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864849.874941:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546628608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788864849.874989:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864849.875026:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc9f42ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788864849.875065:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546628608 00000100:00100000:1.0:1788864849.875071:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546628608 00000100:00100000:1.0:1788864849.875110:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788864849.875119:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546628608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788864849.875132:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864849.875142:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdca4d15c00/0xf8c13e2d0e9592bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e9592b5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864849.875162:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdca4d15c00/0xf8c13e2d0e9592bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e9592b5 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864849.875182:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdca4d15c00/0xf8c13e2d0e9592bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e9592b5 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864849.875205:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca4d15c00, rc 0) 00000100:00100000:1.0:1788864849.875248:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:5832:x1875760546628608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864849.875254:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788864849.875452:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546628608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788864849.875465:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e9592b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9592bc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864849.875473:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e9592b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e9592bc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864849.875542:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546628736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788864849.875568:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864849.875597:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc873c1480 going to sleep for 11 seconds 00000100:00100000:0.0:1788864849.875863:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546628736 00000100:00100000:0.0:1788864849.875869:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546628736 00000100:00100000:0.0:1788864849.875895:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788864849.875902:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:5832:x1875760546628736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788864849.876131:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:5832:x1875760546628736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864849.876138:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788864849.876272:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546628736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788864849.876327:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546628864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788864849.876362:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864849.876390:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc873c1480 going to sleep for 11 seconds 00000100:00100000:1.0:1788864849.876458:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546628864 00000100:00100000:1.0:1788864849.876462:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546628864 00000100:00100000:1.0:1788864849.876494:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788864849.876500:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:5832:x1875760546628864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788864849.876634:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:5832:x1875760546628864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864849.876641:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788864849.876695:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546628864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788864849.878017:0:11195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788864849.878335:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788864849.878354:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788864849.878364:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e9592b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9592bc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864849.878376:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e9592b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9592bc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864849.937650:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864849.938657:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528767744 00000100:00100000:1.0:1788864849.938668:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528767744 00000100:00100000:3.0:1788864849.938988:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 237 00000100:00100000:3.0:1788864849.939001:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+11:5597:x1875760528767744:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788864849.939017:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864849.939034:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e9592c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fa93 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864849.939061:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e9592c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa93 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864849.939082:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e9592c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa93 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864849.939460:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213e400, rc 0) 00000100:00100000:3.0:1788864849.939581:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+12:5597:x1875760528767744:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 583us (1939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864849.939596:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 237 00000100:00100000:1.0:1788864849.944592:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864849.945269:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528767872 00000100:00100000:0.0:1788864849.945280:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528767872 00000100:00100000:0.0:1788864849.945333:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 238 00000100:00100000:0.0:1788864849.945342:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+12:5597:x1875760528767872:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788864849.945601:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+12:5597:x1875760528767872:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 259us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864849.945610:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 238 00000100:00100000:3.0:1788864849.948131:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864849.950541:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528768000 00000100:00100000:0.0:1788864849.950555:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528768000 00000100:00100000:0.0:1788864849.950610:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 239 00000100:00100000:0.0:1788864849.950627:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+12:5597:x1875760528768000:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788864849.950854:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+12:5597:x1875760528768000:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 228us (2729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864849.950862:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 239 00000100:00100000:2.0:1788864849.960660:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864849.960751:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528768128 00000100:00100000:1.0:1788864849.960761:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528768128 00000100:00100000:1.0:1788864849.960856:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 240 00000100:00100000:1.0:1788864849.960867:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+12:5597:x1875760528768128:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788864849.960884:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864849.960901:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdca4d14600/0xf8c13e2d0e9592ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fa9a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864849.960927:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdca4d14600/0xf8c13e2d0e9592ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa9a expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864849.960938:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdca4d14600/0xf8c13e2d0e9592ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa9a expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864849.960953:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca4d14600, rc 0) 00000100:00100000:1.0:1788864849.961004:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+13:5597:x1875760528768128:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 140us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864849.961012:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 240 00000100:00100000:0.0:1788864849.963652:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864849.963733:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528768256 00000100:00100000:1.0:1788864849.963742:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528768256 00000100:00100000:1.0:1788864849.963781:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 241 00000100:00100000:1.0:1788864849.963790:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:5597:x1875760528768256:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788864849.964053:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:5597:x1875760528768256:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 263us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864849.964060:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 241 00000100:00100000:2.0:1788864849.966164:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864849.966244:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528768384 00000100:00100000:1.0:1788864849.966252:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528768384 00000100:00100000:1.0:1788864849.966313:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 242 00000100:00100000:1.0:1788864849.966322:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+13:5597:x1875760528768384:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788864849.966528:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+13:5597:x1875760528768384:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 206us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864849.966536:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 242 00010000:00010000:2.0:1788864850.501898:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864851.268862:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546628992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788864851.268938:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864851.269016:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546628992 00000100:00100000:0.0:1788864851.269022:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546628992 00000100:00100000:0.0:1788864851.269070:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788864851.269077:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546628992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788864851.269107:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788864851.269147:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546628992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864851.269168:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788864851.269187:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788864851.269214:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcacbedf80 x1875760546628992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864851.269230:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546628992:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788864851.525355:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788864852.040672:0:11352:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788864852.293032:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546629120:0@lo:400:kworker.0 00000100:00100000:3.0:1788864852.293115:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864852.293174:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546629632:0@lo:400:kworker.0 00000100:00100000:3.0:1788864852.293209:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864852.293233:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788864852.293239:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546629248:0@lo:400:kworker.0 00000100:00100000:3.0:1788864852.293261:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864852.293275:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546629760:0@lo:400:kworker.0 00000100:00100000:3.0:1788864852.293311:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864852.293431:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546629376:0@lo:400:kworker.0 00000100:00100000:2.0:1788864852.293438:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546629632 00000100:00100000:2.0:1788864852.293446:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546629632 00000100:00100000:0.0:1788864852.293457:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864852.293474:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788864852.293480:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546629504:0@lo:400:kworker.0 00000100:00100000:0.0:1788864852.293500:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864852.293510:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546629248 00000100:00100000:2.0:1788864852.293514:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546629248 00000100:00100000:2.0:1788864852.293526:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546629376 00000100:00100000:2.0:1788864852.293528:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546629376 00000100:00100000:2.0:1788864852.293543:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788864852.293551:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbba7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546629632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864852.293745:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546629120 00000100:00100000:1.0:1788864852.293749:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546629120 00000100:00100000:1.0:1788864852.293776:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788864852.293783:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3300:x1875760546629120:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788864852.293832:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864852.293847:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788864852.293856:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546629248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864852.294264:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbba7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546629632:12345-0@lo:400:kworker.0 Request processed in 711us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864852.294271:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788864852.294299:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788864852.294306:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546629376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864852.294334:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546629376:12345-0@lo:400:kworker.0 Request processed in 30us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864852.294339:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788864852.294380:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546629632:0@lo:400:kworker.0 00000100:00100000:0.0:1788864852.294834:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546629376:0@lo:400:kworker.0 00000100:00100000:3.0:1788864852.294840:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546629248:12345-0@lo:400:kworker.0 Request processed in 986us (1578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864852.294846:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788864852.294871:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546629760 00000100:00100000:0.0:1788864852.294875:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546629760 00000100:00100000:0.0:1788864852.294912:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546629504 00000100:00080000:3.0:1788864852.294914:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788864852.294915:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546629504 00000100:00100000:0.0:1788864852.294936:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788864852.294942:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546629760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864852.294945:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788864852.294952:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546629504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864852.294998:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546629504:12345-0@lo:400:kworker.0 Request processed in 47us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864852.295005:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788864852.295098:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3300:x1875760546629120:12345-0@lo:400:kworker.0 Request processed in 1314us (1981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864852.295114:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788864852.295236:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546629248:0@lo:400:kworker.0 00010000:00080000:2.0:1788864852.295267:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcbfee1180 x1875760546629760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864852.295267:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546629760:12345-0@lo:400:kworker.0 Request processed in 324us (1953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864852.295273:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788864852.295278:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546629760:0@lo:400:kworker.0 00000100:00100000:2.0:1788864852.295297:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546629120:0@lo:400:kworker.0 00010000:00080000:0.0:1788864852.295310:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcbfee1880 x1875760546629504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864852.295319:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546629504:0@lo:400:kworker.0 00010000:00010000:1.0:1788864852.548970:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864852.805089:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788864852.805113:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546629888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788864852.805187:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864852.805458:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546629888 00000100:00100000:2.0:1788864852.805467:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546629888 00000100:00100000:2.0:1788864852.805521:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788864852.805531:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546629888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788864852.805576:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788864852.805629:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546629888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864852.805637:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788864852.805879:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcbc825180 x1875760546629888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864852.805897:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546629888:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788864853.574844:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864853.912484:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864853.912529:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864853.912556:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864853.912595:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528768512 00000100:00100000:1.0:1788864853.912608:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528768512 00000100:00100000:1.0:1788864853.912676:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 244 00000100:00100000:1.0:1788864853.912689:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+13:2356:x1875760528768512:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788864853.912839:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+13:2356:x1875760528768512:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 153us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864853.912925:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 244 00000100:00100000:1.0:1788864853.912978:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528768768 00000100:00100000:1.0:1788864853.912983:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528768768 00000100:00100000:1.0:1788864853.913042:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528768640 00000100:00100000:1.0:1788864853.913046:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528768640 00000100:00100000:1.0:1788864853.913072:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:1.0:1788864853.913080:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2356:x1875760528768768:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788864853.913130:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2356:x1875760528768768:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 51us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864853.913143:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00100000:2.0:1788864853.913173:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2356:x1875760528768640:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788864853.913252:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2356:x1875760528768640:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 95us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864853.913651:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00080000:3.0:1788864853.913827:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788864853.914470:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 89 00010000:00010000:2.0:1788864854.596919:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788864855.474378:0:11452:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 06:54:13 (1788864853) === 00010000:00010000:1.0:1788864855.622316:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864855.653650:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864855.653698:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864855.654023:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528769024 00000100:00100000:3.0:1788864855.654033:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528769024 00000100:00100000:3.0:1788864855.654096:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:3.0:1788864855.654106:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:9714:x1875760528769024:12345-192.168.203.13@tcp:700:mkdir.0 00000100:00100000:3.0:1788864855.654180:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:9714:x1875760528769024:12345-192.168.203.13@tcp:700:mkdir.0 Request processed in 75us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864855.654188:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00080000:1.0:1788864855.654244:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788864855.654302:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528768896 00000100:00100000:2.0:1788864855.654306:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528768896 00000100:00100000:2.0:1788864855.654340:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:2.0:1788864855.654347:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2358:x1875760528768896:12345-192.168.203.13@tcp:41:mkdir.0 00000004:00000024:2.0:1788864855.654373:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788864855.654419:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2358:x1875760528768896:12345-192.168.203.13@tcp:41:mkdir.0 Request processed in 73us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864855.654426:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:1.0:1788864855.657042:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864855.657157:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528769280 00000100:00100000:3.0:1788864855.657166:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528769280 00000100:00100000:3.0:1788864855.657206:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:3.0:1788864855.657214:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:9714:x1875760528769280:12345-192.168.203.13@tcp:36:mkdir.0 00010000:00010000:3.0:1788864855.657273:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864855.657349:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e9591b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa1c expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.657369:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc9124e900) 00010000:00010000:3.0:1788864855.657389:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788864855.657685:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9592d1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.657698:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9592d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.657734:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9592d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.657764:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9592d8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.657780:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9592d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.657787:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9592d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788864855.658903:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788864855.658917:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9592d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.658926:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9592d1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.658933:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9592d1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.658939:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213e600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864855.658943:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9592d1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.658962:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9592d1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.658975:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc834b8e00) 00010000:00010000:3.0:1788864855.658978:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864855.658982:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9592d1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.658988:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9592d1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788864855.659009:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d798e7fb reply state 00000000f0f0a552 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9592d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864855.659018:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788864855.659109:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:9714:x1875760528769280:12345-192.168.203.13@tcp:36:mkdir.0 Request processed in 1893us (2072us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788864855.659118:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00010000:00010000:1.0:1788864855.661128:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9592d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.661144:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9592d8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.661151:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9592d8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.661157:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213f800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864855.661162:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9592d8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.661169:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9592d8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.661186:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fdc834b8500) 00010000:00010000:1.0:1788864855.661189:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864855.661194:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9592d8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.661200:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9592d8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864855.670631:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864855.670740:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528769408 00000100:00100000:2.0:1788864855.670751:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528769408 00000100:00100000:2.0:1788864855.670807:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:2.0:1788864855.670821:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:9715:x1875760528769408:12345-192.168.203.13@tcp:101:chmod.0 00010000:00010000:2.0:1788864855.670842:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864855.670864:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384400/0xf8c13e2d0e9592df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975faa1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.670940:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e9592e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.670954:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e9592e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.670966:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e9592e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864855.671000:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788864855.671004:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788864855.671042:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e9592e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.671069:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384400/0xf8c13e2d0e9592df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975faa1 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.671087:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e9592e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975faa1 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.671096:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:2.0:1788864855.671099:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788864855.671103:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385000, rc 0) 00000100:00100000:2.0:1788864855.671171:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:9715:x1875760528769408:12345-192.168.203.13@tcp:101:chmod.0 Request processed in 355us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864855.671179:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:2.0:1788864855.675618:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864855.675737:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528769664 00000100:00100000:3.0:1788864855.675747:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528769664 00000100:00100000:3.0:1788864855.675857:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:3.0:1788864855.675868:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:9715:x1875760528769664:12345-192.168.203.13@tcp:36:chmod.0 00010000:00010000:3.0:1788864855.675919:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864855.675944:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e9592e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975faa1 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.675960:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:3.0:1788864855.675970:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788864855.676009:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9592ed lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.676022:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9592ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.676032:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9592ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788864855.676422:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4856017 reply state 00000000953b3af5 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9592ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864855.676432:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788864855.676439:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788864855.676508:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:9715:x1875760528769664:12345-192.168.203.13@tcp:36:chmod.0 Request processed in 644us (900us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788864855.676516:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00010000:00010000:2.0:1788864855.679983:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9592ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.680015:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9592ed lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.680023:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9592ed lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.680029:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213e600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864855.680034:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9592ed lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.680042:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9592ed lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.680059:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc834b8e00) 00010000:00010000:2.0:1788864855.680062:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788864855.680066:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9592ed lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.680073:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9592ed lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864855.703428:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864855.703571:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528769792 00000100:00100000:1.0:1788864855.703582:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528769792 00000100:00100000:1.0:1788864855.703638:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:1.0:1788864855.703660:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:9716:x1875760528769792:12345-192.168.203.13@tcp:101:chown.0 00010000:00010000:1.0:1788864855.703682:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864855.703737:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9592f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975faa8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.703793:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9592fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.703807:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9592fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.703818:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9592fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864855.703847:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788864855.703850:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788864855.703882:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9592fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.703915:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9592f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975faa8 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.703932:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9592fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975faa8 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.703940:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc8328ef00) 00010000:00010000:1.0:1788864855.703943:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788864855.703946:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc74000, rc 0) 00000100:00100000:1.0:1788864855.703992:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:9716:x1875760528769792:12345-192.168.203.13@tcp:101:chown.0 Request processed in 334us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864855.704006:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:1.0:1788864855.708196:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864855.708317:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528769920 00000100:00100000:2.0:1788864855.708327:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528769920 00000100:00100000:2.0:1788864855.708386:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:2.0:1788864855.708397:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:9716:x1875760528769920:12345-192.168.203.13@tcp:101:chown.0 00010000:00010000:2.0:1788864855.708422:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864855.708441:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384400/0xf8c13e2d0e959302 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975faaf expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.708537:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959309 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.708552:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959309 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.708684:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959309 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.708842:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959310 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.708852:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959310 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.708860:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959310 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.710240:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959317 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.710256:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.710278:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788864855.710532:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788864855.710537:0:6705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788864855.710571:0:6705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.710585:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959309 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.710592:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959309 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.710599:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959309 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.710605:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864855.710610:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959309 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.710628:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959309 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.710641:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc8328ef00) 00010000:00010000:3.0:1788864855.710644:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864855.710649:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959309 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.710655:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959309 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.710669:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959310 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.710674:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959310 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.710680:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959310 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.710684:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864855.710687:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959310 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.710692:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959310 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.710699:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fdc9124ea00) 00010000:00010000:3.0:1788864855.710719:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864855.710723:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959310 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.710738:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959310 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.710777:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384400/0xf8c13e2d0e959302 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975faaf expref: 10 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.710792:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959317 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975faaf expref: 9 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.710799:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fdc9124e700) 00010000:00010000:3.0:1788864855.710801:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788864855.710804:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385200, rc 0) 00000100:00100000:3.0:1788864855.710880:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:9716:x1875760528769920:12345-192.168.203.13@tcp:101:chown.0 Request processed in 2483us (2692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864855.710899:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:0.0:1788864855.716617:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864855.716889:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528770176 00000100:00100000:1.0:1788864855.716908:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528770176 00000100:00100000:0.0:1788864855.717032:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:0.0:1788864855.717045:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:9716:x1875760528770176:12345-192.168.203.13@tcp:36:chown.0 00010000:00010000:0.0:1788864855.717098:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864855.717124:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959317 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975faaf expref: 9 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864855.717143:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fdc9124e700) 00010000:00010000:0.0:1788864855.717153:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788864855.717176:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497600/0xf8c13e2d0e95931e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864855.717189:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497600/0xf8c13e2d0e95931e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864855.717216:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497600/0xf8c13e2d0e95931e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788864855.759166:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1788864855.759351:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004dd0b703 reply state 00000000d338b708 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497600/0xf8c13e2d0e95931e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864855.759364:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788864855.759391:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:2.0:1788864855.759590:0:5835:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788864855.759654:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:9716:x1875760528770176:12345-192.168.203.13@tcp:36:chown.0 Request processed in 42608us (43042us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788864855.759662:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00010000:00010000:3.0:1788864855.760177:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497600/0xf8c13e2d0e95931e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.760188:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497600/0xf8c13e2d0e95931e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.760196:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497600/0xf8c13e2d0e95931e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.760202:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdc81497600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864855.760206:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497600/0xf8c13e2d0e95931e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.760224:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497600/0xf8c13e2d0e95931e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.760240:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:3.0:1788864855.760243:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788864855.760247:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497600/0xf8c13e2d0e95931e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.760253:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497600/0xf8c13e2d0e95931e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864855.788781:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864855.788900:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528770304 00000100:00100000:3.0:1788864855.788910:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528770304 00000100:00100000:3.0:1788864855.788975:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:3.0:1788864855.788986:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:9717:x1875760528770304:12345-192.168.203.13@tcp:101:touch.500 00010000:00010000:3.0:1788864855.789008:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864855.789026:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959325 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fab6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788864855.792784:0:5836:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3706us 00010000:00010000:2.0:1788864855.805275:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95932c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.806471:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95932c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.806485:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95932c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.806505:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959333 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.806511:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959333 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.806517:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959333 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.806885:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e95933a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.806894:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e95933a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.806901:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e95933a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864855.806936:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788864855.806940:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788864855.806973:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e95933a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.806984:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95932c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.806991:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95932c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.806997:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95932c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.807003:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864855.807007:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95932c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.807014:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95932c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.807025:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc8328ef00) 00010000:00010000:2.0:1788864855.807028:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864855.807032:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95932c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.807038:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95932c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.807047:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959333 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.807062:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959333 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.807068:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959333 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.807072:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864855.807075:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959333 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.807081:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959333 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.807088:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fdc9124ec00) 00010000:00010000:2.0:1788864855.807090:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864855.807093:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959333 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.807098:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959333 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.807135:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959325 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fab6 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.807150:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e95933a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fab6 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.807157:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fdc9124e700) 00010000:00010000:2.0:1788864855.807159:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788864855.807166:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385200, rc 0) 00000100:00100000:2.0:1788864855.807228:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:9717:x1875760528770304:12345-192.168.203.13@tcp:101:touch.500 Request processed in 18244us (18458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864855.807238:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:2.0:1788864855.826509:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864855.827402:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528770560 00000100:00100000:1.0:1788864855.827415:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528770560 00000100:00100000:1.0:1788864855.827477:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:1.0:1788864855.827488:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:9717:x1875760528770560:12345-192.168.203.13@tcp:101:touch.500 00010000:00010000:1.0:1788864855.827507:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864855.827527:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959341 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fabd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.827821:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e959348 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.827838:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e959348 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.827851:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e959348 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.827907:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95934f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.827915:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95934f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.827921:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95934f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788864855.828657:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788864855.828955:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959356 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.828968:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.828977:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.829008:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e959348 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.829015:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e959348 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.829022:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e959348 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.829029:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864855.829033:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e959348 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.829041:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e959348 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.829052:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fdc9124e700) 00010000:00010000:1.0:1788864855.829055:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864855.829060:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e959348 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.829076:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e959348 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788864855.829089:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032856b4f reply state 0000000097522cc2 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95934f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864855.829098:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788864855.829132:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959341 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fabd expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.829146:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959356 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fabd expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.829154:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:1.0:1788864855.829156:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788864855.829159:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc75400, rc 0) 00000100:00100000:1.0:1788864855.829234:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+10:9717:x1875760528770560:12345-192.168.203.13@tcp:101:touch.500 Request processed in 1746us (2732us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788864855.829242:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00010000:00010000:2.0:1788864855.843456:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95934f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.843473:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95934f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.843481:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95934f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.843486:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864855.843491:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95934f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.843498:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95934f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.843515:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x25480f0f (ffff9fdc8328e200) 00010000:00010000:2.0:1788864855.843518:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864855.843523:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95934f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.843529:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95934f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864855.855929:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864855.856191:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528770816 00000100:00100000:0.0:1788864855.856201:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528770816 00000100:00100000:0.0:1788864855.856269:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:0.0:1788864855.856280:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:9717:x1875760528770816:12345-192.168.203.13@tcp:36:touch.500 00010000:00010000:0.0:1788864855.856343:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864855.856375:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959356 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fabd expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864855.856395:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:0.0:1788864855.856406:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788864855.856479:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497c00/0xf8c13e2d0e959364 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864855.856493:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497c00/0xf8c13e2d0e959364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864855.856504:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497c00/0xf8c13e2d0e959364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788864855.856631:0:6705:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000910a45dd reply state 000000004faf7bf7 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497c00/0xf8c13e2d0e959364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864855.856640:0:6705:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788864855.856793:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+10:9717:x1875760528770816:12345-192.168.203.13@tcp:36:touch.500 Request processed in 514us (876us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788864855.856800:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00010000:00010000:3.0:1788864855.858586:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497c00/0xf8c13e2d0e959364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.858602:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497c00/0xf8c13e2d0e959364 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.858609:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497c00/0xf8c13e2d0e959364 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.858615:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdc81497c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864855.858620:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497c00/0xf8c13e2d0e959364 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.858640:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497c00/0xf8c13e2d0e959364 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.858654:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fdca4f57c00) 00010000:00010000:3.0:1788864855.858657:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864855.858661:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497c00/0xf8c13e2d0e959364 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.858667:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497c00/0xf8c13e2d0e959364 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864855.859028:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864855.859113:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528770944 00000100:00100000:0.0:1788864855.859122:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528770944 00000100:00100000:0.0:1788864855.859172:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:0.0:1788864855.859181:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:9717:x1875760528770944:12345-192.168.203.13@tcp:101:touch.500 00010000:00010000:0.0:1788864855.859204:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864855.859221:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81496600/0xf8c13e2d0e95936b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fac4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864855.859283:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81496600/0xf8c13e2d0e95936b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fac4 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864855.859297:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81496600/0xf8c13e2d0e95936b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fac4 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864855.859316:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fdca4f57d00) 00010000:00010000:0.0:1788864855.859318:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788864855.859321:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdc81496600, rc 0) 00000100:00100000:0.0:1788864855.859377:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+10:9717:x1875760528770944:12345-192.168.203.13@tcp:101:touch.500 Request processed in 196us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864855.859384:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:0.0:1788864855.867904:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864855.868511:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528771072 00000100:00100000:1.0:1788864855.868522:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528771072 00000100:00100000:1.0:1788864855.868574:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:1.0:1788864855.868583:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1875760528771072:12345-192.168.203.13@tcp:8:touch.500 00010000:00080000:1.0:1788864855.868627:0:6684:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:1.0:1788864855.868658:0:6684:0:(genops.c:1384:class_connect()) connect: client 1cf2dd0f-7f2d-465e-9303-244222bc89bf, cookie 0xf8c13e2d0e959372 00002000:00100000:1.0:1788864855.868670:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1cf2dd0f-7f2d-465e-9303-244222bc89bf/ffff9fdcbdc71800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788864855.868731:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788864855.868962:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788864855.868994:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9fdcbdc54000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788864855.869068:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2355:x1875760528771072:12345-192.168.203.13@tcp:8:touch.500 Request processed in 484us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864855.869077:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:2.0:1788864855.873987:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864855.874085:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528771200 00000100:00100000:0.0:1788864855.874094:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528771200 00000100:00100000:0.0:1788864855.874169:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:0.0:1788864855.874180:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0360380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:0:x1875760528771200:12345-192.168.203.13@tcp:2:touch.500 00000100:00080000:1.0:1788864855.874373:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788864855.919111:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:2.0:1788864855.919140:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1cf2dd0f-7f2d-465e-9303-244222bc89bf 00000100:00100000:3.0:1788864855.919425:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0360380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:0:x1875760528771200:12345-192.168.203.13@tcp:2:touch.500 Request processed in 45240us (45441us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788864855.919437:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:2.0:1788864855.922466:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864855.924043:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528771456 00000100:00100000:1.0:1788864855.924059:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528771456 00000100:00100000:1.0:1788864855.924299:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:1.0:1788864855.924310:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+10:9717:x1875760528771456:12345-192.168.203.13@tcp:35:touch.500 00000100:00100000:1.0:1788864855.924670:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+11:9717:x1875760528771456:12345-192.168.203.13@tcp:35:touch.500 Request processed in 360us (2210us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788864855.924677:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:0.0:1788864855.939566:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864855.939818:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528771584 00000100:00100000:3.0:1788864855.939827:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528771584 00000100:00100000:3.0:1788864855.939907:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:3.0:1788864855.939914:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+11:9718:x1875760528771584:12345-192.168.203.13@tcp:101:rm.0 00010000:00010000:3.0:1788864855.939933:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864855.939949:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fe00/0xf8c13e2d0e959379 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975facb expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.940000:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959380 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.940010:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.940019:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788864855.940054:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788864855.940058:0:6705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788864855.940096:0:6705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.940123:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fe00/0xf8c13e2d0e959379 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975facb expref: 13 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.940140:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975facb expref: 12 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864855.940148:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fdc9124e700) 00010000:00010000:3.0:1788864855.940152:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788864855.940155:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213ec00, rc 0) 00000100:00100000:3.0:1788864855.940221:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+12:9718:x1875760528771584:12345-192.168.203.13@tcp:101:rm.0 Request processed in 307us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864855.940228:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:3.0:1788864855.945257:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864855.945392:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528771840 00000100:00100000:1.0:1788864855.945401:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528771840 00000100:00100000:1.0:1788864855.945454:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:1.0:1788864855.945464:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+12:9718:x1875760528771840:12345-192.168.203.13@tcp:101:rm.0 00010000:00010000:1.0:1788864855.945484:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864855.945504:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959387 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fad2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864855.945586:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788864855.945798:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959387 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fad2 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.945824:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc8328ef00) 00010000:00010000:1.0:1788864855.945827:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788864855.945833:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959387 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fad2 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.945845:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc75200, rc 0) 00000100:00100000:1.0:1788864855.945909:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+13:9718:x1875760528771840:12345-192.168.203.13@tcp:101:rm.0 Request processed in 446us (660us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1788864855.945917:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:0.0:1788864855.954332:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864855.954439:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528771968 00000100:00100000:3.0:1788864855.954450:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528771968 00000100:00100000:3.0:1788864855.954509:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:3.0:1788864855.954521:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+13:9718:x1875760528771968:12345-192.168.203.13@tcp:37:rm.0 00000100:00100000:3.0:1788864855.963356:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+13:9718:x1875760528771968:12345-192.168.203.13@tcp:37:rm.0 Request processed in 8828us (9026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864855.963368:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:0.0:1788864855.967170:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864855.967356:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528772224 00000100:00100000:1.0:1788864855.967366:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528772224 00000100:00100000:1.0:1788864855.967426:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:1.0:1788864855.967437:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb1038050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+13:9718:x1875760528772224:12345-192.168.203.13@tcp:35:rm.0 00000100:00100000:1.0:1788864855.967668:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb1038050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+14:9718:x1875760528772224:12345-192.168.203.13@tcp:35:rm.0 Request processed in 233us (507us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788864855.967677:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:0.0:1788864855.971296:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864855.971403:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528772480 00000100:00100000:2.0:1788864855.971414:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528772480 00000100:00100000:2.0:1788864855.971503:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:2.0:1788864855.971513:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+14:9718:x1875760528772480:12345-192.168.203.13@tcp:101:rm.0 00010000:00010000:2.0:1788864855.971537:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864855.971558:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959395 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fad9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.971669:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95939c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.971684:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95939c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.971696:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95939c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864855.971995:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788864855.972133:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959395 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fad9 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.972154:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95939c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fad9 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.972163:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fdc9124e700) 00010000:00010000:2.0:1788864855.972179:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788864855.972182:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384000, rc 0) 00000100:00100000:2.0:1788864855.972288:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+16:9718:x1875760528772480:12345-192.168.203.13@tcp:101:rm.0 Request processed in 775us (999us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788864855.972295:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:0.0:1788864855.975661:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864855.975948:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528772608 00000100:00100000:1.0:1788864855.975957:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528772608 00000100:00100000:1.0:1788864855.976013:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:1.0:1788864855.976024:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+16:9718:x1875760528772608:12345-192.168.203.13@tcp:41:rm.0 00000004:00000024:1.0:1788864855.976082:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1788864855.976228:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+16:9718:x1875760528772608:12345-192.168.203.13@tcp:41:rm.0 Request processed in 203us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864855.976235:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:3.0:1788864855.981700:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864855.981990:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528772736 00000100:00100000:1.0:1788864855.982000:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528772736 00000100:00100000:1.0:1788864855.982056:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:1.0:1788864855.982066:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+16:9718:x1875760528772736:12345-192.168.203.13@tcp:101:rm.0 00010000:00010000:1.0:1788864855.982084:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864855.982103:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9593aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fae0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982173:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e9593b1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982187:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e9593b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982198:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e9593b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982211:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74e00/0xf8c13e2d0e9593b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x25480f0f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982217:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74e00/0xf8c13e2d0e9593b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982222:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74e00/0xf8c13e2d0e9593b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982358:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9593bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982367:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9593bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982385:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9593bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864855.982412:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788864855.982416:0:6705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788864855.982433:0:6705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9593bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982443:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9593bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982451:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e9593b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982457:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e9593b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982463:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e9593b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982468:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864855.982472:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e9593b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982480:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e9593b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982490:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fdc9124e700) 00010000:00010000:1.0:1788864855.982493:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864855.982498:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e9593b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982512:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e9593b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982525:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74e00/0xf8c13e2d0e9593b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982531:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74e00/0xf8c13e2d0e9593b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982536:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74e00/0xf8c13e2d0e9593b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982540:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864855.982543:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74e00/0xf8c13e2d0e9593b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982550:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74e00/0xf8c13e2d0e9593b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982557:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x25480f0f (ffff9fdc8328ed00) 00010000:00010000:1.0:1788864855.982559:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864855.982562:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74e00/0xf8c13e2d0e9593b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982567:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74e00/0xf8c13e2d0e9593b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982596:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9593aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fae0 expref: 18 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982609:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9593bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fae0 expref: 17 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.982622:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fdca4f57d00) 00010000:00010000:1.0:1788864855.982624:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788864855.982627:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc74600, rc 0) 00000100:00100000:1.0:1788864855.982692:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+17:9718:x1875760528772736:12345-192.168.203.13@tcp:101:rm.0 Request processed in 628us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864855.982700:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:3.0:1788864855.986327:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864855.986407:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528772992 00000100:00100000:2.0:1788864855.986417:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528772992 00000100:00100000:2.0:1788864855.986477:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:2.0:1788864855.986487:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+17:9718:x1875760528772992:12345-192.168.203.13@tcp:36:rm.0 00010000:00010000:2.0:1788864855.986540:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788864855.986568:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9593bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fae0 expref: 17 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.986590:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81496600/0xf8c13e2d0e95936b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fac4 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.986603:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fdca4f57d00) 00010000:00010000:2.0:1788864855.986619:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959380 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975facb expref: 15 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.986628:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fdc9124e700) 00010000:00010000:2.0:1788864855.986632:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788864855.986652:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e9593c6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.986665:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e9593c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.986674:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e9593c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.986738:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e9593cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.986747:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e9593cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.986755:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e9593cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.987014:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e9593d4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.987023:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e9593d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.987030:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e9593d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788864855.988351:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788864855.988365:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 279119661000ns, next at 280119657304ns, rc = 0 00010000:00010000:2.0:1788864855.988430:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9593db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.988446:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9593db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.988456:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9593db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.988464:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9593db lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.988484:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9593db lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.988490:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9593db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.988551:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788864855.988574:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e9593d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.988580:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e9593d4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.988587:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e9593d4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.988592:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864855.988596:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e9593d4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.988604:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e9593d4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.988615:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fdc9124ea00) 00010000:00010000:2.0:1788864855.988618:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788864855.988622:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e9593d4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.988628:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e9593d4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.988645:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e9593c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.988658:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e9593c6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.988664:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e9593c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.988669:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864855.988672:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e9593c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.988678:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e9593c6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.988686:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fdc9124e700) 00010000:00010000:2.0:1788864855.988689:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864855.988692:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e9593c6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.988698:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e9593c6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788864855.988743:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079b514bd reply state 0000000032ed754d transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e9593cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864855.988752:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788864855.989160:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+16:9718:x1875760528772992:12345-192.168.203.13@tcp:36:rm.0 Request processed in 2670us (2840us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788864855.989169:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00010000:00010000:1.0:1788864855.991936:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788864855.991951:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9593db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.991968:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385c00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788864855.991973:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9593db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.991984:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9593db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.992002:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fdc9124ea00) 00010000:00010000:1.0:1788864855.992005:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788864855.992010:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9593db lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.992017:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9593db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.992082:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864855.992086:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864855.992102:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864855.992389:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e9593cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.992398:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e9593cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.992405:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e9593cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.992410:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864855.992414:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e9593cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.992420:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e9593cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.992429:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x25480f0f (ffff9fdc9124ec00) 00010000:00010000:2.0:1788864855.992432:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864855.992435:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e9593cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864855.992441:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e9593cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864855.994179:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864855.994479:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528773248 00000100:00100000:1.0:1788864855.994490:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528773248 00000100:00100000:1.0:1788864855.994572:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:1.0:1788864855.994583:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+15:9718:x1875760528773248:12345-192.168.203.13@tcp:35:rm.0 00000100:00100000:0.0:1788864855.996188:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+16:9718:x1875760528773248:12345-192.168.203.13@tcp:35:rm.0 Request processed in 1600us (2009us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788864855.996200:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:2.0:1788864855.998482:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864855.998539:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528773504 00000100:00100000:1.0:1788864855.998548:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528773504 00000100:00100000:1.0:1788864855.998600:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:1.0:1788864855.998609:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+16:9718:x1875760528773504:12345-192.168.203.13@tcp:36:rm.0 00010000:00010000:1.0:1788864855.998663:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788864855.998689:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95939c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fad9 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.998729:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e95933a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fab6 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.998741:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fdc9124e700) 00010000:00010000:1.0:1788864855.998754:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9592fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975faa8 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.998770:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc8328ef00) 00010000:00010000:1.0:1788864855.998777:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788864855.998798:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74a00/0xf8c13e2d0e9593e2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.998810:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74a00/0xf8c13e2d0e9593e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.998819:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74a00/0xf8c13e2d0e9593e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.998837:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e9593e9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.998861:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e9593e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.998868:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e9593e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.999071:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75c00/0xf8c13e2d0e9593f0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.999079:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75c00/0xf8c13e2d0e9593f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.999087:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75c00/0xf8c13e2d0e9593f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864855.999577:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788864855.999591:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75c00/0xf8c13e2d0e9593f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.999598:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75c00/0xf8c13e2d0e9593f0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.999605:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75c00/0xf8c13e2d0e9593f0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.999610:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864855.999614:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75c00/0xf8c13e2d0e9593f0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.999621:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75c00/0xf8c13e2d0e9593f0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.999639:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fdc8328e300) 00010000:00010000:1.0:1788864855.999641:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788864855.999645:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75c00/0xf8c13e2d0e9593f0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.999652:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75c00/0xf8c13e2d0e9593f0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.999670:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74a00/0xf8c13e2d0e9593e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.999676:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74a00/0xf8c13e2d0e9593e2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.999681:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74a00/0xf8c13e2d0e9593e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.999686:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864855.999689:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74a00/0xf8c13e2d0e9593e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.999694:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74a00/0xf8c13e2d0e9593e2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.999701:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:1.0:1788864855.999722:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864855.999725:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74a00/0xf8c13e2d0e9593e2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864855.999730:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74a00/0xf8c13e2d0e9593e2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788864855.999750:0:6705:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f7b03b3 reply state 000000006a4f9931 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e9593e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864855.999759:0:6705:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788864855.999828:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+15:9718:x1875760528773504:12345-192.168.203.13@tcp:36:rm.0 Request processed in 1219us (1353us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788864855.999835:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00010000:00010000:3.0:1788864856.011247:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e9593e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864856.011274:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e9593e9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864856.011282:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e9593e9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864856.011289:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864856.011294:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e9593e9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864856.011302:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e9593e9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864856.011320:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fdc8328e200) 00010000:00010000:3.0:1788864856.011323:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864856.011329:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e9593e9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864856.011335:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e9593e9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864856.388912:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcb7ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546630016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788864856.388995:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864856.389595:0:10234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546630016 00000100:00100000:1.0:1788864856.389604:0:10234:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546630016 00000100:00100000:1.0:1788864856.389674:0:10234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788864856.389684:0:10234:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546630016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788864856.389735:0:10234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788864856.389812:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788864856.390751:0:10234:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546630016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1066us (1753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864856.390761:0:10234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788864856.391067:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcb7ff4000 x1875760546630016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864856.391090:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcb7ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546630016:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788864856.644959:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864857.413462:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcb7ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546630144:0@lo:400:kworker.0 00000100:00100000:0.0:1788864857.413527:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864857.413579:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcb7ff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546630656:0@lo:400:kworker.0 00000100:00100000:0.0:1788864857.413605:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864857.413631:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788864857.413637:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcb7ff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546630272:0@lo:400:kworker.0 00000100:00100000:0.0:1788864857.413658:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864857.413679:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcb7ff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546630784:0@lo:400:kworker.0 00000100:00100000:0.0:1788864857.413726:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864857.413767:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcb7ff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546630400:0@lo:400:kworker.0 00000100:00100000:0.0:1788864857.413792:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864857.413810:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788864857.413815:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcb7ff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546630528:0@lo:400:kworker.0 00000100:00100000:0.0:1788864857.413837:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864857.413867:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546630656 00000100:00100000:0.0:1788864857.413875:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546630656 00000100:00100000:0.0:1788864857.413933:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546630272 00000100:00100000:0.0:1788864857.413936:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546630272 00000100:00100000:0.0:1788864857.413950:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546630400 00000100:00100000:0.0:1788864857.413953:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546630400 00000100:00100000:0.0:1788864857.413982:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788864857.413990:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546630656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864857.414038:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546630656:12345-0@lo:400:kworker.0 Request processed in 47us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864857.414045:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788864857.414062:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788864857.414068:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546630272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864857.414105:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546630272:12345-0@lo:400:kworker.0 Request processed in 37us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864857.414111:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788864857.414122:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788864857.414128:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546630400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864857.414157:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546630400:12345-0@lo:400:kworker.0 Request processed in 30us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864857.414163:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788864857.414180:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546630784 00000100:00100000:0.0:1788864857.414183:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546630784 00000100:00100000:0.0:1788864857.414206:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546630528 00000100:00100000:0.0:1788864857.414209:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546630528 00000100:00100000:0.0:1788864857.414229:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788864857.414235:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546630784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864857.414274:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546630784:12345-0@lo:400:kworker.0 Request processed in 39us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864857.414280:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788864857.414291:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788864857.414296:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546630528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864857.414335:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546630528:12345-0@lo:400:kworker.0 Request processed in 38us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864857.414341:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1788864857.414357:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788864857.414361:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788864857.414389:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcb7ff6d80 x1875760546630528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864857.414401:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcb7ff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546630528:0@lo:400:kworker.0 00000100:00100000:0.0:1788864857.414413:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcb7ff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546630400:0@lo:400:kworker.0 00000100:00100000:0.0:1788864857.414439:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcb7ff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546630272:0@lo:400:kworker.0 00010000:00080000:0.0:1788864857.414448:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcb7ff5500 x1875760546630784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864857.414457:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcb7ff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546630784:0@lo:400:kworker.0 00000100:00100000:0.0:1788864857.414466:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcb7ff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546630656:0@lo:400:kworker.0 00000100:00100000:1.0:1788864857.416337:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546630144 00000100:00100000:1.0:1788864857.416349:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546630144 00000100:00100000:1.0:1788864857.416395:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788864857.416405:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3300:x1875760546630144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864857.416475:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3300:x1875760546630144:12345-0@lo:400:kworker.0 Request processed in 72us (2948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864857.416482:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788864857.416538:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcb7ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546630144:0@lo:400:kworker.0 00010000:00010000:1.0:1788864857.669512:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864857.925514:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfe0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546630912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788864857.925590:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864857.926282:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546630912 00000100:00100000:2.0:1788864857.926292:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546630912 00000100:00100000:2.0:1788864857.926352:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788864857.926361:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546630912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788864857.926400:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788864857.926467:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546630912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864857.926474:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788864857.926515:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcbfe0b800 x1875760546630912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864857.926535:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfe0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546630912:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788864858.694582:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864859.027338:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864859.027433:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864859.027466:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864859.027489:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864859.027561:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528773888 00000100:00100000:0.0:1788864859.027571:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528773888 00000100:00100000:0.0:1788864859.027649:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:0.0:1788864859.027660:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2358:x1875760528773888:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788864859.027751:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2358:x1875760528773888:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 93us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864859.027759:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:0.0:1788864859.027794:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528773760 00000100:00100000:0.0:1788864859.027798:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528773760 00000100:00100000:0.0:1788864859.027823:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528774016 00000100:00100000:0.0:1788864859.027825:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528774016 00000100:00100000:0.0:1788864859.027848:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:0.0:1788864859.027855:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+14:2358:x1875760528773760:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788864859.027888:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+14:2358:x1875760528773760:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 34us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864859.027895:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:0.0:1788864859.027907:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:0.0:1788864859.027914:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528774016:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788864859.027957:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528774016:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 42us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864859.027972:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00080000:2.0:1788864859.028281:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788864859.028286:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788864859.029276:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528773632 00000100:00100000:3.0:1788864859.029285:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528773632 00000100:00100000:3.0:1788864859.029371:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 246 00000100:00100000:3.0:1788864859.029380:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+13:2358:x1875760528773632:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864859.029434:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+13:2358:x1875760528773632:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 56us (2105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864859.029441:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 246 00000001:02000400:0.0:1788864859.481268:0:11602:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1788864859.717951:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788864860.559572:0:11650:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5dc63300 20000000:00000080:1.0:1788864860.559588:0:11650:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fdcc0655800 uarg=0000000000000000 20000000:01000000:1.0:1788864860.559627:0:11650:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788864860.559633:0:11650:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788864860.559638:0:11650:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788864860.560373:0:11651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788864860.560566:0:11650:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788864860.565226:0:11650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788864860.565301:0:11650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788864860.565360:0:11650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788864860.565377:0:11650:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788864860.565468:0:11650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fdcb5384400/0xf8c13e2d0e9593f7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.565486:0:11650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdca4d14e00/0xf8c13e2d0e9592a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e959299 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.565495:0:11650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdca4d14200/0xf8c13e2d0e9592ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e9592a7 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.565502:0:11650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdca4d15c00/0xf8c13e2d0e9592bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e9592b5 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.565520:0:11650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e9592c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa93 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.565527:0:11650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdca4d14600/0xf8c13e2d0e9592ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa9a expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.565535:0:11650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fdcb5384400/0xf8c13e2d0e9593f7 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.565573:0:11650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdca4d14600/0xf8c13e2d0e9592ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa9a expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.565587:0:11650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fdca4d14600/0xf8c13e2d0e9592ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa9a expref: 12 pid: 5828 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864860.565600:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0360e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11650:1875760546631040:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788864860.566004:0:11650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e9592c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa93 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.566013:0:11650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e9592c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa93 expref: 12 pid: 5827 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864860.566022:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0363480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11650:1875760546631168:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788864860.566058:0:11650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdca4d15c00/0xf8c13e2d0e9592bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e9592b5 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.566066:0:11650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fdca4d15c00/0xf8c13e2d0e9592bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e9592b5 expref: 18 pid: 5828 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864860.566088:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0361180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11650:1875760546631296:0@lo:104: 00000100:00100000:2.0:1788864860.566131:0:11650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788864860.566175:0:11650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdca4d14200/0xf8c13e2d0e9592ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e9592a7 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.566183:0:11650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fdca4d14200/0xf8c13e2d0e9592ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e9592a7 expref: 18 pid: 5830 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864860.566190:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0361880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11650:1875760546631424:0@lo:104: 00000100:00100000:2.0:1788864860.566209:0:11650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864860.566249:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546631296 00000100:00100000:2.0:1788864860.566256:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546631296 00000100:00100000:2.0:1788864860.566289:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546631424 00000100:00100000:2.0:1788864860.566292:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546631424 00000100:00100000:2.0:1788864860.566305:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788864860.566312:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0362a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+4:11650:x1875760546631296:12345-0@lo:104: 00010000:00010000:2.0:1788864860.566324:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e9592b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e9592bc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.566366:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788864860.566372:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0362a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+4:11650:x1875760546631296:12345-0@lo:104: Request processed in 60us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864860.566379:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788864860.566408:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788864860.566414:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0363b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+3:11650:x1875760546631424:12345-0@lo:104: 00010000:00010000:2.0:1788864860.566421:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385800/0xf8c13e2d0e9592a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e9592ae expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.566466:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788864860.566471:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0363b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+3:11650:x1875760546631424:12345-0@lo:104: Request processed in 59us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864860.566478:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788864860.566497:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788864860.566503:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e9592b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e9592bc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.566510:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdc80030c00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1788864860.566514:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e9592b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e9592bc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.566522:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e9592b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e9592bc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788864860.566530:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e9592b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e9592bc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864860.566535:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788864860.566571:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e9592b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e9592bc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.566578:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788864860.566595:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e9592b5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e9592bc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.566602:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdc80030c00/0xf8c13e2d0e9592b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e9592bc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.566625:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864860.566628:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385800/0xf8c13e2d0e9592a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e9592ae expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.566633:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385800 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1788864860.566636:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385800/0xf8c13e2d0e9592a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e9592ae expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.566643:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385800/0xf8c13e2d0e9592a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e9592ae expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788864860.566649:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385800/0xf8c13e2d0e9592a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e9592ae expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864860.566654:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788864860.566668:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385800/0xf8c13e2d0e9592a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e9592ae expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.566674:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788864860.566688:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385800/0xf8c13e2d0e9592a7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e9592ae expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.566695:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385800/0xf8c13e2d0e9592a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e9592ae expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.566725:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864860.566727:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864860.566729:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864860.566749:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788864860.566766:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86ebad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546631552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788864860.566796:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864860.566825:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546631552 00000100:00100000:2.0:1788864860.566830:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546631552 00010000:00010000:2.0:1788864860.566847:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdca4d15c00/0xf8c13e2d0e9592bc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e9592b5 expref: 19 pid: 5828 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864860.566868:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788864860.566875:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3302:x1875760546631552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788864860.566886:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864860.566891:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdca4d15c00/0xf8c13e2d0e9592bc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e9592b5 expref: 19 pid: 5828 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.566900:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdca4d15c00/0xf8c13e2d0e9592bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e9592b5 expref: 19 pid: 5828 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.566915:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864860.566942:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3302:x1875760546631552:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864860.566948:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788864860.566980:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86ebad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546631552:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788864860.567016:0:11650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdca4d14e00/0xf8c13e2d0e9592a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e959299 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.567024:0:11650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fdca4d14e00/0xf8c13e2d0e9592a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e959299 expref: 18 pid: 5827 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864860.567033:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86ebad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11650:1875760546631808:0@lo:104: 00000100:00100000:2.0:1788864860.567058:0:11650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864860.567092:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788864860.567102:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546631808 00000100:00100000:2.0:1788864860.567106:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546631808 00000100:00100000:2.0:1788864860.567125:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788864860.567131:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc1625c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+3:11650:x1875760546631808:12345-0@lo:104: 00010000:00010000:2.0:1788864860.567139:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14800/0xf8c13e2d0e959299 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e9592a0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.567168:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788864860.567173:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc1625c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+3:11650:x1875760546631808:12345-0@lo:104: Request processed in 43us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864860.567179:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1788864860.567212:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864860.567216:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14800/0xf8c13e2d0e959299 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e9592a0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.567223:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca4d14800 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1788864860.567226:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14800/0xf8c13e2d0e959299 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e9592a0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.567246:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14800/0xf8c13e2d0e959299 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e9592a0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788864860.567253:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14800/0xf8c13e2d0e959299 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e9592a0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864860.567258:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788864860.567272:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14800/0xf8c13e2d0e959299 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e9592a0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.567289:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788864860.567297:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14800/0xf8c13e2d0e959299 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e9592a0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.567302:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdca4d14800/0xf8c13e2d0e959299 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e9592a0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.567315:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864860.567317:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864860.567319:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864860.567328:0:11650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1e353c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788864860.567342:0:11650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdca4d15c00/0xf8c13e2d0e9592bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e9592b5 expref: 18 pid: 5828 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864860.567353:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0361180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11650:1875760546631296:0@lo:104: 00000100:00100000:2.0:1788864860.567361:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0361880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11650:1875760546631424:0@lo:104: 00000100:00100000:2.0:1788864860.567368:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86ebad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11650:1875760546631808:0@lo:104: 00010000:00010000:1.0:1788864860.567590:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864860.567613:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546631680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788864860.567642:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864860.567669:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788864860.567674:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546631936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788864860.567694:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864860.567916:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546631680 00000100:00100000:1.0:1788864860.567921:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546631680 00010000:00010000:1.0:1788864860.567940:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdca4d14200/0xf8c13e2d0e9592ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e9592a7 expref: 18 pid: 5830 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864860.567953:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546631936 00000100:00100000:1.0:1788864860.567956:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546631936 00010000:00010000:1.0:1788864860.567965:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdca4d14e00/0xf8c13e2d0e9592a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e959299 expref: 19 pid: 5827 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864860.567978:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788864860.567985:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3300:x1875760546631680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788864860.567993:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864860.567998:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdca4d14200/0xf8c13e2d0e9592ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e9592a7 expref: 19 pid: 5830 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864860.568006:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdca4d14200/0xf8c13e2d0e9592ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e9592a7 expref: 19 pid: 5830 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864860.568018:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdca4d14200/0xf8c13e2d0e9592ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e9592a7 expref: 19 pid: 5830 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864860.568037:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864860.568067:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:3300:x1875760546631680:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864860.568073:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788864860.568087:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788864860.568093:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1e50450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:3300:x1875760546631936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788864860.568100:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864860.568104:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdca4d14e00/0xf8c13e2d0e9592a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e959299 expref: 17 pid: 5827 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864860.568112:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdca4d14e00/0xf8c13e2d0e9592a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e959299 expref: 17 pid: 5827 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864860.568123:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdca4d14e00/0xf8c13e2d0e9592a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e959299 expref: 17 pid: 5827 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864860.568130:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864860.568149:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1e50450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:3300:x1875760546631936:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864860.568155:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788864860.568201:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546631936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788864860.568210:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546631680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788864860.578683:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864860.578749:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864860.578855:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528774272 00000100:00100000:3.0:1788864860.578864:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528774272 00010000:00010000:3.0:1788864860.578900:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e9592c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa93 expref: 13 pid: 5827 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864860.578934:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528774144 00000100:00100000:3.0:1788864860.578937:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528774144 00010000:00010000:3.0:1788864860.578946:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdca4d14600/0xf8c13e2d0e9592ca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa9a expref: 14 pid: 5828 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864860.578959:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:3.0:1788864860.578968:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:202cc404-00bb-4314-9125-b9b0b45f494c+14:2359:x1875760528774272:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788864860.578980:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864860.578985:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e9592c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa93 expref: 14 pid: 5827 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864860.578994:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e9592c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa93 expref: 14 pid: 5827 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864860.579023:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788864860.579080:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:202cc404-00bb-4314-9125-b9b0b45f494c+14:2359:x1875760528774272:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 111us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864860.579101:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:3.0:1788864860.579120:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:3.0:1788864860.579126:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:202cc404-00bb-4314-9125-b9b0b45f494c+13:2359:x1875760528774144:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788864860.579134:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864860.579138:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdca4d14600/0xf8c13e2d0e9592ca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa9a expref: 13 pid: 5828 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864860.579147:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdca4d14600/0xf8c13e2d0e9592ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa9a expref: 13 pid: 5828 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864860.579159:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fdcb5384400/0xf8c13e2d0e9593f7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864860.579168:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcb5384400/0xf8c13e2d0e9593f7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864860.579183:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fdcb5384400/0xf8c13e2d0e9593f7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864860.579189:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fdcb5384400/0xf8c13e2d0e9593f7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864860.579196:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fdcb5384400/0xf8c13e2d0e9593f7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864860.579201:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fdcb5384400/0xf8c13e2d0e9593f7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864860.579213:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384400 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:3.0:1788864860.579222:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fdcb5384400/0xf8c13e2d0e9593f7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864860.579240:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fdcb5384400/0xf8c13e2d0e9593f7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864860.579251:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fdcb5384400/0xf8c13e2d0e9593f7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864860.579262:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788864860.579288:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:202cc404-00bb-4314-9125-b9b0b45f494c+13:2359:x1875760528774144:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 161us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864860.579294:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00010000:00010000:2.0:1788864860.580047:0:11650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdca4d14600/0xf8c13e2d0e9592ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa9a expref: 12 pid: 5828 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864860.580063:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0360e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11650:1875760546631040:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788864860.580076:0:11650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e9592c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa93 expref: 11 pid: 5827 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864860.580085:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0363480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11650:1875760546631168:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788864860.580172:0:11650:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fdcb5384400/0xf8c13e2d0e9593f7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.580195:0:11650:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fdcb5384400/0xf8c13e2d0e9593f7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.580201:0:11650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fdcb5384400/0xf8c13e2d0e9593f7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.580207:0:11650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcb5384400/0xf8c13e2d0e9593f7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864860.743292:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788864861.084129:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000001:00080000:3.0:1788864861.084433:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1788864861.084459:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788864861.084805:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788864861.084823:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86ebad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546632064:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788864861.084888:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864861.085046:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546632064 00000100:00100000:2.0:1788864861.085054:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546632064 00000100:00100000:2.0:1788864861.085110:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788864861.085119:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546632064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788864861.085152:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1788864861.085185:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9fe957, atime: 0x6a9fe957, ctime: 0x6a9fe957, blocks: 0x1 00010000:00010000:2.0:1788864861.085193:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fca997b4/0xf8c13e2d0e9593fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864861.085208:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=284s v=(0 0) 00010000:00010000:2.0:1788864861.085213:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864861.085219:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fca997b4/0xf8c13e2d0e9593fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864861.085245:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fca997b4/0xf8c13e2d0e9593fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864861.085273:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fca997b4/0xf8c13e2d0e9593fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864861.085281:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fca997b4/0xf8c13e2d0e9593fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864861.085301:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788864861.086072:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875760546632064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 951us (1181us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788864861.086081:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788864861.086108:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864861.086114:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fca997b4/0xf8c13e2d0e9593fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788864861.086298:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fdc86ebad80/2, rc 0, transno 4294967300 00000100:00100000:1.0:1788864861.086311:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86ebad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546632064:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788864861.086360:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384400 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:2.0:1788864861.086365:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fca997b4/0xf8c13e2d0e9593fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864861.086375:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fca997b4/0xf8c13e2d0e9593fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864861.086391:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fca997b4/0xf8c13e2d0e9593fe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864861.086399:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fca997b4/0xf8c13e2d0e9593fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864861.086551:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864861.086553:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864861.086554:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788864861.086881:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788864861.509476:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788864861.509586:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcb7ff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546632192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788864861.509653:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864861.510164:0:10234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546632192 00000100:00100000:0.0:1788864861.510172:0:10234:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546632192 00000100:00100000:0.0:1788864861.510341:0:10234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788864861.510353:0:10234:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875760546632192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788864861.510388:0:10234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788864861.510445:0:10234:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875760546632192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864861.510483:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcb7ff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546632192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788864861.511087:0:10234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1788864861.766130:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788864861.892822:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788864861.892830:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fdcbfd92000 from 7 10000000:01000000:1.0:1788864861.892835:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788864861.892885:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e959405 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864861.892897:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e959405 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864861.892907:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e959405 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864861.892933:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546632320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788864861.893013:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864861.893079:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc07def00 going to sleep for 11 seconds 00000100:00100000:3.0:1788864861.893127:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546632320 00000100:00100000:3.0:1788864861.893144:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546632320 00000100:00100000:3.0:1788864861.893218:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788864861.893239:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:5832:x1875760546632320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788864861.893258:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864861.893279:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdb8213fe00/0xf8c13e2d0e95940c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e959405 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864861.893311:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdb8213fe00/0xf8c13e2d0e95940c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e959405 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864861.893329:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdb8213fe00/0xf8c13e2d0e95940c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e959405 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864861.893364:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213fe00, rc 0) 00000100:00100000:2.0:1788864861.894088:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546632320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 847us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864861.894100:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788864861.894218:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546632320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788864861.894252:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e959405 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95940c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864861.894263:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e959405 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95940c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864861.894345:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546632448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788864861.894373:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864861.894402:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc07def00 going to sleep for 11 seconds 00000100:00100000:3.0:1788864861.894488:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546632448 00000100:00100000:3.0:1788864861.894498:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546632448 00000100:00100000:3.0:1788864861.894547:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788864861.894556:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546632448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788864861.895536:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546632448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 977us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864861.895548:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788864861.895943:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546632448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788864861.896005:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546632576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788864861.896065:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864861.896112:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc07def00 going to sleep for 11 seconds 00000100:00100000:2.0:1788864861.896188:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546632576 00000100:00100000:2.0:1788864861.896195:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546632576 00000100:00100000:2.0:1788864861.896301:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788864861.896313:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546632576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788864861.896550:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546632576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 239us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864861.896558:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788864861.896648:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546632576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788864861.897803:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:11666:1875760546632704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788864861.897881:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864861.898273:0:11666:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc07de000 going to sleep for 11 seconds 00000100:00100000:0.0:1788864861.898456:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546632704 00000100:00100000:0.0:1788864861.898473:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546632704 00000100:00100000:0.0:1788864861.898516:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788864861.898525:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:11666:x1875760546632704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864861.899018:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:11666:x1875760546632704:12345-0@lo:502:llog_process_th.0 Request processed in 492us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864861.899027:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788864861.899235:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:11666:1875760546632704:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788864861.899281:0:11666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788864861.899294:0:11666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864861.899296:0:11666:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788864861.899304:0:11666:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fdcbfd92000 00000020:00000080:1.0:1788864861.899307:0:11666:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788864861.899420:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:11666:1875760546632832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788864861.899474:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864861.899499:0:11666:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc07de000 going to sleep for 11 seconds 00000100:00100000:1.0:1788864861.901460:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546632832 00000100:00100000:1.0:1788864861.901475:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546632832 00000100:00100000:1.0:1788864861.901527:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788864861.901538:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:11666:x1875760546632832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788864861.904049:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:11666:x1875760546632832:12345-0@lo:502:llog_process_th.0 Request processed in 2500us (4563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864861.904066:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788864861.904155:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:11666:1875760546632832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788864861.904206:0:11666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788864861.904216:0:11666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864861.904228:0:11666:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788864861.904233:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788864861.904334:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788864861.904358:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788864861.904372:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e959405 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95940c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864861.904386:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e959405 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95940c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864861.904398:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788864861.904401:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fdcacbf0000 from 7 10000000:01000000:3.0:1788864861.904404:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788864861.904444:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fc00/0xf8c13e2d0e959413 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864861.904544:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fc00/0xf8c13e2d0e959413 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864861.904558:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fc00/0xf8c13e2d0e959413 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864861.904592:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfe09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546632960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788864861.904636:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864861.904682:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc83329300 going to sleep for 11 seconds 00000100:00100000:1.0:1788864861.905386:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546632960 00000100:00100000:1.0:1788864861.905398:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546632960 00000100:00100000:1.0:1788864861.905466:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788864861.905477:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1ee9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:5832:x1875760546632960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788864861.905495:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864861.905514:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcafc74a00/0xf8c13e2d0e95941a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e959413 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864861.905545:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcafc74a00/0xf8c13e2d0e95941a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e959413 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864861.905558:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcafc74a00/0xf8c13e2d0e95941a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e959413 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864861.905567:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc74a00, rc 0) 00000100:00100000:1.0:1788864861.905634:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1ee9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546632960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864861.905641:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788864861.905697:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfe09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546632960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788864861.905929:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fc00/0xf8c13e2d0e959413 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95941a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864861.905940:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fc00/0xf8c13e2d0e959413 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95941a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864861.906027:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546633088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788864861.906060:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864861.906088:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc07de840 going to sleep for 11 seconds 00000100:00100000:1.0:1788864861.906103:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546633088 00000100:00100000:1.0:1788864861.906108:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546633088 00000100:00100000:1.0:1788864861.906129:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788864861.906135:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546633088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788864861.906451:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546633088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864861.906460:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788864861.906497:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546633088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788864861.906529:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546633216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788864861.906569:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864861.906582:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc07de840 going to sleep for 11 seconds 00000100:00100000:1.0:1788864861.906595:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546633216 00000100:00100000:1.0:1788864861.906599:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546633216 00000100:00100000:1.0:1788864861.906868:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788864861.906875:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eeb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546633216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788864861.907053:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eeb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:5832:x1875760546633216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864861.907061:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788864861.907109:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546633216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788864861.907343:0:11668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:11668:1875760546633344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788864861.907392:0:11668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864861.907414:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546633344 00000100:00100000:1.0:1788864861.907419:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546633344 00000100:00100000:1.0:1788864861.907455:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788864861.907463:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:11668:x1875760546633344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864861.908039:0:11668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc07de480 going to sleep for 11 seconds 00000100:00100000:0.0:1788864861.915617:0:11668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:11668:1875760546633344:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788864861.915690:0:11668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788864861.915725:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864861.915728:0:11668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788864861.915736:0:11668:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fdcacbf0000 00000020:00000080:0.0:1788864861.915740:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788864861.915866:0:11668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcb7ff6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:11668:1875760546633472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864861.915956:0:11668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864861.916015:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546633472 00000100:00100000:0.0:1788864861.916024:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546633472 00000100:00100000:0.0:1788864861.916073:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788864861.916083:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:11668:x1875760546633472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864861.916366:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:11668:x1875760546633472:12345-0@lo:502:llog_process_th.0 Request processed in 283us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864861.916374:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788864861.916434:0:11668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc87333780 going to sleep for 11 seconds 00000100:00100000:0.0:1788864861.916463:0:11668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcb7ff6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:11668:1875760546633472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788864861.916485:0:11668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788864861.916490:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864861.916500:0:11668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788864861.916505:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788864861.916691:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788864861.916740:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788864861.916751:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fc00/0xf8c13e2d0e959413 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95941a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864861.916763:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fc00/0xf8c13e2d0e959413 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95941a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864861.916774:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788864861.916777:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fdc8878e000 from 7 10000000:01000000:0.0:1788864861.916779:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788864861.916808:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdc81497c00/0xf8c13e2d0e959421 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864861.916816:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdc81497c00/0xf8c13e2d0e959421 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864861.916825:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdc81497c00/0xf8c13e2d0e959421 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864861.916842:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcb7ff6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546633600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788864861.916874:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864861.916891:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc87333780 going to sleep for 11 seconds 00000100:00100000:0.0:1788864861.916903:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546633600 00000100:00100000:0.0:1788864861.916907:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546633600 00000100:00100000:0.0:1788864861.916932:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788864861.916939:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:5832:x1875760546633600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788864861.916949:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864861.916970:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdc81496600/0xf8c13e2d0e959428 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e959421 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864861.916997:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdc81496600/0xf8c13e2d0e959428 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e959421 expref: 20 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864861.917009:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdc81496600/0xf8c13e2d0e959428 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e959421 expref: 20 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864861.917018:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdc81496600, rc 0) 00000100:00100000:0.0:1788864861.917050:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+20:5832:x1875760546633600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864861.917056:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788864861.917087:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcb7ff6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546633600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788864861.917100:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdc81497c00/0xf8c13e2d0e959421 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959428 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864861.917110:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdc81497c00/0xf8c13e2d0e959421 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e959428 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864861.917156:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcb7ff6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546633728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788864861.917182:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864861.917195:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc87333780 going to sleep for 11 seconds 00000100:00100000:0.0:1788864861.917205:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546633728 00000100:00100000:0.0:1788864861.917209:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546633728 00000100:00100000:0.0:1788864861.917237:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788864861.917244:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+20:5832:x1875760546633728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788864861.917501:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+20:5832:x1875760546633728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864861.917515:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788864861.917549:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcb7ff6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546633728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788864861.917578:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcb7ff6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546633856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788864861.917613:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864861.917625:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc87333780 going to sleep for 11 seconds 00000100:00100000:0.0:1788864861.917635:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546633856 00000100:00100000:0.0:1788864861.917638:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546633856 00000100:00100000:0.0:1788864861.917652:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788864861.917658:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+20:5832:x1875760546633856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788864861.917813:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+20:5832:x1875760546633856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864861.917821:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788864861.917856:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcb7ff6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:5832:1875760546633856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788864861.918069:0:11670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcb7ff6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:11670:1875760546633984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864861.918102:0:11670:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864861.918120:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546633984 00000100:00100000:0.0:1788864861.918124:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546633984 00000100:00100000:0.0:1788864861.918144:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788864861.918150:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+20:11670:x1875760546633984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864861.918288:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+20:11670:x1875760546633984:12345-0@lo:502:llog_process_th.0 Request processed in 137us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864861.918294:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788864861.918323:0:11670:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc87333e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788864861.918336:0:11670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcb7ff6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:11670:1875760546633984:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788864861.918363:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788864861.918373:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864861.918375:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788864861.918382:0:11670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fdc8878e000 00000020:00000080:0.0:1788864861.918384:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788864861.918454:0:11670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcb7ff6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:11670:1875760546634112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864861.918487:0:11670:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864861.918505:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546634112 00000100:00100000:0.0:1788864861.918508:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546634112 00000100:00100000:0.0:1788864861.918528:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788864861.918533:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+20:11670:x1875760546634112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864861.918636:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+20:11670:x1875760546634112:12345-0@lo:502:llog_process_th.0 Request processed in 101us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864861.918642:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788864861.918668:0:11670:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc87333e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788864861.918680:0:11670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcb7ff6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:11670:1875760546634112:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788864861.918699:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788864861.918737:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864861.918739:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788864861.918742:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788864861.918792:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788864861.918807:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788864861.918816:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdc81497c00/0xf8c13e2d0e959421 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959428 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864861.918826:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdc81497c00/0xf8c13e2d0e959421 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959428 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864861.924939:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:11668:x1875760546633344:12345-0@lo:502:llog_process_th.0 Request processed in 17460us (17529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864861.924959:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000040:00080000:3.0:1788864861.933595:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788864862.227103:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864862.227181:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528774400 00000100:00100000:0.0:1788864862.227191:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528774400 00000100:00100000:0.0:1788864862.227268:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 262 00000100:00100000:0.0:1788864862.227279:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+11:5597:x1875760528774400:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788864862.227296:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864862.227315:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdc81497600/0xf8c13e2d0e95942f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fae7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864862.227354:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdc81497600/0xf8c13e2d0e95942f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fae7 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864862.227365:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdc81497600/0xf8c13e2d0e95942f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fae7 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864862.227374:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdc81497600, rc 0) 00000100:00100000:0.0:1788864862.227435:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+12:5597:x1875760528774400:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 158us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864862.227442:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 262 00000100:00100000:3.0:1788864862.241997:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864862.242082:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528774528 00000100:00100000:1.0:1788864862.242093:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528774528 00000100:00100000:1.0:1788864862.242143:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 263 00000100:00100000:1.0:1788864862.242154:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+12:5597:x1875760528774528:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788864862.242548:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+12:5597:x1875760528774528:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 395us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864862.242555:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 263 00000100:00100000:1.0:1788864862.251000:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864862.251089:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528774656 00000100:00100000:2.0:1788864862.251099:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528774656 00000100:00100000:2.0:1788864862.251152:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 264 00000100:00100000:2.0:1788864862.251163:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+12:5597:x1875760528774656:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788864862.251403:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+12:5597:x1875760528774656:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 241us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864862.251411:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 264 00000100:00100000:3.0:1788864862.266854:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864862.267095:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528774784 00000100:00100000:1.0:1788864862.267105:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528774784 00000100:00100000:1.0:1788864862.267165:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 265 00000100:00100000:1.0:1788864862.267175:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+12:9989:x1875760528774784:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788864862.267539:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+12:9989:x1875760528774784:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 363us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864862.267547:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 265 00000100:00100000:3.0:1788864862.275698:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864862.275822:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528774912 00000100:00100000:0.0:1788864862.275846:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528774912 00000100:00100000:0.0:1788864862.275901:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 266 00000100:00100000:0.0:1788864862.275911:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+12:9989:x1875760528774912:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788864862.276317:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+12:9989:x1875760528774912:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 406us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864862.276326:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 266 00000100:00100000:0.0:1788864862.281933:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864862.282102:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528775040 00000100:00100000:2.0:1788864862.282112:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528775040 00000100:00100000:2.0:1788864862.282177:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 267 00000100:00100000:2.0:1788864862.282186:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+12:5597:x1875760528775040:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788864862.282202:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864862.282228:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcb5384400/0xf8c13e2d0e959436 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c2384dba975faee expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864862.282257:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcb5384400/0xf8c13e2d0e959436 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975faee expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864862.282268:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcb5384400/0xf8c13e2d0e959436 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975faee expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864862.282278:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384400, rc 0) 00000100:00100000:2.0:1788864862.282330:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+13:5597:x1875760528775040:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 144us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864862.282338:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 267 00000100:00100000:3.0:1788864862.289159:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864862.293290:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528775168 00000100:00100000:0.0:1788864862.293307:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528775168 00000100:00100000:0.0:1788864862.293381:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 268 00000100:00100000:0.0:1788864862.293392:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+13:5597:x1875760528775168:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788864862.293690:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+13:5597:x1875760528775168:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 299us (4539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864862.293698:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 268 00000100:00100000:3.0:1788864862.296022:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864862.296194:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528775296 00000100:00100000:1.0:1788864862.296203:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528775296 00000100:00100000:1.0:1788864862.296281:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 269 00000100:00100000:1.0:1788864862.296290:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:5597:x1875760528775296:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788864862.296593:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:5597:x1875760528775296:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 302us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864862.296602:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 269 00000100:00100000:1.0:1788864862.306677:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864862.311633:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528775424 00000100:00100000:2.0:1788864862.311647:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528775424 00000100:00100000:2.0:1788864862.311743:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 270 00000100:00100000:2.0:1788864862.311753:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+13:9992:x1875760528775424:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788864862.312006:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+13:9992:x1875760528775424:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 252us (5336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864862.312015:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 270 00000100:00100000:3.0:1788864862.326946:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864862.327043:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528775552 00000100:00100000:1.0:1788864862.327053:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528775552 00000100:00100000:1.0:1788864862.327122:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 271 00000100:00100000:1.0:1788864862.327132:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:9992:x1875760528775552:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788864862.327393:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:9992:x1875760528775552:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 261us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864862.327401:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 271 00000100:00100000:3.0:1788864862.533917:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546634496:0@lo:400:kworker.0 00000100:00100000:2.0:1788864862.533917:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546634240:0@lo:400:kworker.0 00000100:00100000:1.0:1788864862.533939:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875760546634624:0@lo:400:kworker.0 00000100:00100000:0.0:1788864862.534071:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875760546634368:0@lo:400:kworker.0 00000100:00100000:2.0:1788864862.537165:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864862.537267:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546634752:0@lo:400:kworker.0 00000100:00100000:2.0:1788864862.537324:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864862.537373:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546634752 00000100:00100000:2.0:1788864862.537380:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546634752 00000100:00100000:2.0:1788864862.537442:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788864862.537451:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546634752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864862.537627:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546634752:12345-0@lo:400:kworker.0 Request processed in 176us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864862.537635:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1788864862.537655:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788864862.537685:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcbfee3b80 x1875760546634752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864862.537698:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546634752:0@lo:400:kworker.0 00000100:00100000:2.0:1788864862.537761:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546634240 00000100:00100000:2.0:1788864862.537766:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546634240 00000100:00100000:2.0:1788864862.537793:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788864862.537801:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546634240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864862.537847:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546634240:12345-0@lo:400:kworker.0 Request processed in 47us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864862.537854:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788864862.537883:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546634240:0@lo:400:kworker.0 00000100:00100000:3.0:1788864862.540357:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864862.540520:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864862.540655:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546634496 00000100:00100000:2.0:1788864862.540664:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546634496 00000100:00100000:2.0:1788864862.540740:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788864862.540762:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1875760546634496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864862.540964:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864862.541018:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546634624 00000100:00100000:1.0:1788864862.541027:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546634624 00000100:00100000:1.0:1788864862.541097:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546634368 00000100:00100000:1.0:1788864862.541100:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546634368 00000100:00100000:1.0:1788864862.541122:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788864862.541132:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875760546634624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864862.541185:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875760546634624:12345-0@lo:400:kworker.0 Request processed in 55us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864862.541193:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788864862.541210:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788864862.541228:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875760546634368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864862.541278:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875760546634368:12345-0@lo:400:kworker.0 Request processed in 61us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864862.541294:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788864862.541345:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875760546634624:0@lo:400:kworker.0 00000100:00080000:0.0:1788864862.541606:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788864862.541629:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875760546634368:0@lo:400:kworker.0 00000100:00100000:2.0:1788864862.548050:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1875760546634496:12345-0@lo:400:kworker.0 Request processed in 7291us (7688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864862.548094:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788864862.554667:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546634496:0@lo:400:kworker.0 00010000:00010000:2.0:1788864862.789384:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788864862.982344:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788864863.046635:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfe0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546634880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788864863.046941:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864863.047076:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546634880 00000100:00100000:3.0:1788864863.047085:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546634880 00000100:00100000:3.0:1788864863.047153:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788864863.047374:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546634880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788864863.047410:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788864863.047512:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546634880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 350us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864863.047521:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1788864863.058435:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcbfe0b800 x1875760546634880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864863.058464:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfe0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546634880:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788864863.813059:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864864.145188:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864864.145237:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864864.145285:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864864.145302:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528775808 00000100:00100000:3.0:1788864864.145313:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528775808 00000100:00100000:3.0:1788864864.145431:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528776064 00000100:00100000:3.0:1788864864.145446:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528776064 00000100:00100000:3.0:1788864864.145473:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:3.0:1788864864.145482:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2359:x1875760528775808:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864864.145549:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2359:x1875760528775808:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 67us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864864.145565:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:0.0:1788864864.145600:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528775680 00000100:00100000:0.0:1788864864.145605:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528775680 00000100:00100000:0.0:1788864864.145644:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 272 00000100:00100000:0.0:1788864864.145652:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+13:2359:x1875760528775680:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788864864.145682:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+13:2359:x1875760528775680:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 32us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864864.145698:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 272 00000100:00100000:3.0:1788864864.145737:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:3.0:1788864864.145746:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2359:x1875760528776064:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864864.145778:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2359:x1875760528776064:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 34us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864864.145785:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00080000:1.0:1788864864.145913:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788864864.146256:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864864.146300:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528775936 00000100:00100000:3.0:1788864864.146306:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528775936 00000100:00100000:3.0:1788864864.146352:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:3.0:1788864864.146406:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2359:x1875760528775936:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864864.146447:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2359:x1875760528775936:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 44us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864864.146453:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00080000:1.0:1788864864.146509:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788864864.836918:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864865.861073:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788864866.195822:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:1.0:1788864866.629061:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788864866.629087:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcb7ff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546635008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788864866.629166:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864866.629244:0:10234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546635008 00000100:00100000:0.0:1788864866.629253:0:10234:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546635008 00000100:00100000:0.0:1788864866.629311:0:10234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788864866.629321:0:10234:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546635008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788864866.629353:0:10234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788864866.629406:0:10234:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546635008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864866.629413:0:10234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788864866.629486:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000100:00080000:1.0:1788864866.629490:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788864866.629493:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fdc86ebad80, transno 4294967300 00000100:00100000:2.0:1788864866.629519:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcb7ff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546635008:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788864866.886855:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864867.655257:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788864867.655350:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86ebaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546635264:0@lo:400:kworker.0 00000100:00100000:0.0:1788864867.655424:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864867.655584:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546635264 00000100:00100000:1.0:1788864867.655593:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546635264 00000100:00100000:1.0:1788864867.655646:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788864867.655655:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546635264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864867.655770:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546635136:0@lo:400:kworker.0 00000100:00100000:3.0:1788864867.655807:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864867.655851:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875760546635392:0@lo:400:kworker.0 00000100:00100000:3.0:1788864867.655875:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864867.655905:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546635392 00000100:00100000:3.0:1788864867.655909:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546635392 00000100:00100000:3.0:1788864867.655958:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788864867.655965:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875760546635392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864867.656000:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875760546635392:12345-0@lo:400:kworker.0 Request processed in 36us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864867.656007:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788864867.656046:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875760546635392:0@lo:400:kworker.0 00000100:00080000:3.0:1788864867.656065:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864867.656082:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546635136 00000100:00100000:3.0:1788864867.656086:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546635136 00000100:00100000:3.0:1788864867.656109:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788864867.656115:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3302:x1875760546635136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864867.656149:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3302:x1875760546635136:12345-0@lo:400:kworker.0 Request processed in 33us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864867.656156:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788864867.656200:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546635136:0@lo:400:kworker.0 00000100:00100000:2.0:1788864867.657987:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788864867.658003:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546635776:0@lo:400:kworker.0 00000100:00100000:3.0:1788864867.658035:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86ebb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546635520:0@lo:400:kworker.0 00000100:00100000:2.0:1788864867.658056:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864867.658071:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864867.658086:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788864867.658091:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86ebbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875760546635648:0@lo:400:kworker.0 00000100:00100000:2.0:1788864867.658095:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546635776 00000100:00100000:3.0:1788864867.658114:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864867.658114:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546635776 00000100:00100000:3.0:1788864867.658138:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546635648 00000100:00100000:3.0:1788864867.658141:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546635648 00000100:00100000:2.0:1788864867.658159:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546635520 00000100:00100000:2.0:1788864867.658161:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546635520 00000100:00100000:3.0:1788864867.658167:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788864867.658188:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788864867.658197:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875760546635648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864867.658197:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546635776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864867.658237:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875760546635648:12345-0@lo:400:kworker.0 Request processed in 42us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864867.658237:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546635776:12345-0@lo:400:kworker.0 Request processed in 42us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864867.658244:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788864867.658253:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788864867.658257:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788864867.658263:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546635520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864867.658288:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86ebbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875760546635648:0@lo:400:kworker.0 00000100:00100000:2.0:1788864867.658288:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546635520:12345-0@lo:400:kworker.0 Request processed in 26us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864867.658294:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788864867.658297:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86ebb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546635520:0@lo:400:kworker.0 00010000:00080000:2.0:1788864867.658323:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc86eb8a80 x1875760546635776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788864867.658327:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788864867.658331:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788864867.658341:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546635776:0@lo:400:kworker.0 00000100:00100000:1.0:1788864867.658670:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546635264:12345-0@lo:400:kworker.0 Request processed in 3013us (3242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864867.658677:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788864867.658819:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86ebaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546635264:0@lo:400:kworker.0 00010000:00010000:1.0:1788864867.909533:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864868.165209:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788864868.165493:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546635904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788864868.165551:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864868.168274:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546635904 00000100:00100000:1.0:1788864868.168291:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546635904 00000100:00100000:1.0:1788864868.168369:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788864868.168381:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546635904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788864868.168437:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788864868.168527:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546635904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (2974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864868.168536:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788864868.168569:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdb81d58700 x1875760546635904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864868.168591:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546635904:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788864868.932921:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864869.265029:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864869.265070:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864869.265109:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864869.265135:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528776320 00000100:00100000:1.0:1788864869.265146:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528776320 00000100:00100000:0.0:1788864869.265189:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864869.265219:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528776576 00000100:00100000:1.0:1788864869.265224:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528776576 00000100:00100000:0.0:1788864869.265224:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528776448 00000100:00100000:0.0:1788864869.265237:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528776448 00000100:00100000:1.0:1788864869.265268:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 103 00000100:00100000:1.0:1788864869.265279:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2359:x1875760528776320:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788864869.265296:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:0.0:1788864869.265307:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2359:x1875760528776448:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788864869.265355:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2359:x1875760528776320:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 78us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864869.265363:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 103 00000100:00100000:1.0:1788864869.265379:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 104 00000100:00100000:1.0:1788864869.265385:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2359:x1875760528776576:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788864869.265450:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528776192 00000100:00100000:2.0:1788864869.265456:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528776192 00000100:00100000:2.0:1788864869.265480:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 274 00000100:00100000:2.0:1788864869.265493:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:2359:x1875760528776192:12345-192.168.203.13@tcp:400:kworker.0 00000100:00080000:3.0:1788864869.265565:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788864869.265579:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788864869.269874:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2359:x1875760528776448:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 4556us (4671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864869.269888:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:2.0:1788864869.270452:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:2359:x1875760528776192:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 4961us (5339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864869.270462:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 274 00000100:00100000:1.0:1788864869.271229:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2359:x1875760528776576:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 5839us (6153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864869.271479:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 104 00010000:00010000:2.0:1788864869.957434:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864870.989580:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864871.749102:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788864871.749127:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc07c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546636032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788864871.749208:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864871.749535:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546636032 00000100:00100000:3.0:1788864871.749544:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546636032 00000100:00100000:3.0:1788864871.749746:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788864871.749757:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546636032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788864871.749791:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788864871.749913:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546636032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864871.749920:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1788864871.749972:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788864871.750221:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc07c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546636032:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788864872.007186:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788864872.197438:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788864872.773115:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546636288:0@lo:400:kworker.0 00000100:00100000:2.0:1788864872.773195:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864872.773264:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546636800:0@lo:400:kworker.0 00000100:00100000:2.0:1788864872.773291:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864872.773323:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788864872.773341:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546636416:0@lo:400:kworker.0 00000100:00100000:2.0:1788864872.773364:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864872.773401:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546636800 00000100:00100000:2.0:1788864872.773408:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546636800 00000100:00100000:2.0:1788864872.773458:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788864872.773467:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546636800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864872.773527:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546636800:12345-0@lo:400:kworker.0 Request processed in 61us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864872.773534:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788864872.773573:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546636288 00000100:00100000:2.0:1788864872.773577:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546636288 00000100:00100000:2.0:1788864872.773598:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546636416 00000100:00100000:2.0:1788864872.773600:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546636416 00000100:00100000:2.0:1788864872.773622:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788864872.773629:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546636288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864872.773660:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546636288:12345-0@lo:400:kworker.0 Request processed in 32us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864872.773666:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788864872.773678:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788864872.773684:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546636416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864872.773734:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546636416:12345-0@lo:400:kworker.0 Request processed in 49us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864872.773739:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788864872.773778:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546636416:0@lo:400:kworker.0 00000100:00100000:2.0:1788864872.773787:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546636288:0@lo:400:kworker.0 00010000:00080000:2.0:1788864872.773799:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcac9f3800 x1875760546636800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864872.773810:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546636800:0@lo:400:kworker.0 00000100:00100000:1.0:1788864872.773817:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546636160:0@lo:400:kworker.0 00000100:00100000:1.0:1788864872.773856:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864872.773906:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875760546636672:0@lo:400:kworker.0 00000100:00100000:1.0:1788864872.773930:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864872.774061:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788864872.774067:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546636544:0@lo:400:kworker.0 00000100:00100000:1.0:1788864872.774091:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864872.774143:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546636672 00000100:00100000:3.0:1788864872.774158:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546636672 00000100:00100000:0.0:1788864872.774181:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546636544 00000100:00100000:0.0:1788864872.774187:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546636544 00000100:00100000:3.0:1788864872.774239:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788864872.774243:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788864872.774250:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875760546636672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864872.774256:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546636544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864872.774302:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875760546636672:12345-0@lo:400:kworker.0 Request processed in 55us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864872.774309:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788864872.774313:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546636544:12345-0@lo:400:kworker.0 Request processed in 60us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864872.774323:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1788864872.774370:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788864872.774375:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788864872.774434:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546636544:0@lo:400:kworker.0 00000100:00100000:3.0:1788864872.774445:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875760546636672:0@lo:400:kworker.0 00000100:00100000:2.0:1788864872.774452:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546636160 00000100:00100000:2.0:1788864872.774459:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546636160 00000100:00100000:2.0:1788864872.774486:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788864872.774494:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3303:x1875760546636160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864872.774550:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3303:x1875760546636160:12345-0@lo:400:kworker.0 Request processed in 57us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864872.774565:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788864872.774582:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546636160:0@lo:400:kworker.0 00010000:00010000:2.0:1788864873.031527:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864873.285881:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788864873.285902:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546636928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788864873.285964:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864873.286106:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546636928 00000100:00100000:1.0:1788864873.286115:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546636928 00000100:00100000:1.0:1788864873.286174:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788864873.286183:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546636928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788864873.286219:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788864873.286279:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546636928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864873.286286:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1788864873.287072:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcac9f0e00 x1875760546636928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864873.287093:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546636928:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788864874.054978:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864874.389085:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864874.389200:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864874.389374:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864874.389419:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864874.389489:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528776704 00000100:00100000:2.0:1788864874.389499:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528776704 00000100:00100000:2.0:1788864874.389557:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 276 00000100:00100000:2.0:1788864874.389568:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:2359:x1875760528776704:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788864874.389658:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:2359:x1875760528776704:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 92us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864874.389666:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 276 00000100:00100000:2.0:1788864874.389719:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528776960 00000100:00100000:2.0:1788864874.389723:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528776960 00000100:00100000:2.0:1788864874.389760:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:2.0:1788864874.389767:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2359:x1875760528776960:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788864874.389795:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2359:x1875760528776960:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 28us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864874.389802:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:3.0:1788864874.389903:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528776832 00000100:00100000:3.0:1788864874.389907:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528776832 00000100:00080000:0.0:1788864874.390079:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788864874.390084:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788864874.391443:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528777088 00000100:00100000:3.0:1788864874.391455:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528777088 00000100:00100000:1.0:1788864874.391483:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:1.0:1788864874.391498:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2359:x1875760528776832:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788864874.391564:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2359:x1875760528776832:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 71us (2489us total) trans 0 rc 0/0 00000100:00080000:0.0:1788864874.391848:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864874.392051:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 109 00000100:00100000:3.0:1788864874.392062:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2359:x1875760528777088:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788864874.392091:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:3.0:1788864874.392305:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2359:x1875760528777088:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 245us (3104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864874.392359:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 109 00010000:00010000:2.0:1788864875.078837:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864876.101758:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864876.868868:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788864876.868894:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc07c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546637056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788864876.869036:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864876.869365:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546637056 00000100:00100000:2.0:1788864876.869374:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546637056 00000100:00100000:2.0:1788864876.869488:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788864876.869499:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546637056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788864876.869544:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788864876.869555:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788864876.869596:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546637056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864876.869604:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788864876.869743:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc07c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546637056:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788864877.125438:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864877.902575:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc07c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546637184:0@lo:400:kworker.0 00000100:00100000:3.0:1788864877.902648:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864877.902875:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc07c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546637568:0@lo:400:kworker.0 00000100:00100000:1.0:1788864877.902920:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864877.902921:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546637184 00000100:00100000:2.0:1788864877.902931:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546637184 00000100:00100000:3.0:1788864877.902955:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc07c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546637312:0@lo:400:kworker.0 00000100:00100000:1.0:1788864877.902971:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546637568 00000100:00100000:1.0:1788864877.902977:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546637568 00000100:00100000:3.0:1788864877.902994:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864877.903021:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788864877.903022:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788864877.903030:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc07c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546637440:0@lo:400:kworker.0 00000100:00100000:1.0:1788864877.903036:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546637568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864877.903057:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864877.903086:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546637312 00000100:00100000:3.0:1788864877.903091:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546637312 00000100:00100000:1.0:1788864877.903121:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546637568:12345-0@lo:400:kworker.0 Request processed in 76us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864877.903131:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788864877.903153:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546637440 00000100:00100000:3.0:1788864877.903157:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546637440 00000100:00100000:1.0:1788864877.903183:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc07c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546637568:0@lo:400:kworker.0 00000100:00100000:3.0:1788864877.903200:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788864877.903208:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546637312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864877.903228:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788864877.903239:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546637440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864877.903249:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546637312:12345-0@lo:400:kworker.0 Request processed in 41us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864877.903256:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788864877.903279:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546637440:12345-0@lo:400:kworker.0 Request processed in 43us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864877.903287:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788864877.903300:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc07c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546637440:0@lo:400:kworker.0 00000100:00080000:1.0:1788864877.903311:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864877.903315:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc07c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546637312:0@lo:400:kworker.0 00000100:00100000:2.0:1788864877.903362:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788864877.903372:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3303:x1875760546637184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864877.903419:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3303:x1875760546637184:12345-0@lo:400:kworker.0 Request processed in 49us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864877.903425:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788864877.903528:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788864877.903535:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc07c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875760546637696:0@lo:400:kworker.0 00000100:00100000:1.0:1788864877.903556:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864877.903617:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546637696 00000100:00100000:0.0:1788864877.903621:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546637696 00000100:00100000:0.0:1788864877.903675:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788864877.903680:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875760546637696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864877.903684:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788864877.903727:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875760546637696:12345-0@lo:400:kworker.0 Request processed in 48us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864877.903731:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788864877.903755:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc07c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875760546637696:0@lo:400:kworker.0 00000100:00080000:1.0:1788864877.903795:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864877.903879:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc07c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546637184:0@lo:400:kworker.0 00000100:00100000:2.0:1788864877.904908:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc07c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546637824:0@lo:400:kworker.0 00000100:00100000:2.0:1788864877.904952:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864877.908541:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546637824 00000100:00100000:0.0:1788864877.908554:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546637824 00000100:00100000:0.0:1788864877.908624:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788864877.908643:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86ebb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546637824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864877.908758:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86ebb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546637824:12345-0@lo:400:kworker.0 Request processed in 127us (3805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864877.908766:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1788864877.908837:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcc07c7800 x1875760546637824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864877.908849:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc07c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546637824:0@lo:400:kworker.0 00000100:00080000:1.0:1788864877.909136:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788864878.149045:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864878.406458:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546637952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788864878.406538:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864878.406758:0:10234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546637952 00000100:00100000:0.0:1788864878.406766:0:10234:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546637952 00000100:00100000:0.0:1788864878.406829:0:10234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788864878.406839:0:10234:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546637952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788864878.406870:0:10234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788864878.408778:0:10234:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546637952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1933us (2233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864878.408789:0:10234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1788864878.409408:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcac9f0700 x1875760546637952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864878.409433:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546637952:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788864879.173212:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864879.513318:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864879.513358:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864879.513517:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528777344 00000100:00100000:1.0:1788864879.513526:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528777344 00000100:00100000:1.0:1788864879.513594:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:1.0:1788864879.513611:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2358:x1875760528777344:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788864879.513888:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2358:x1875760528777344:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 285us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864879.513895:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00080000:0.0:1788864879.513954:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864879.514279:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528777216 00000100:00100000:3.0:1788864879.514284:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528777216 00000100:00100000:3.0:1788864879.514326:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 278 00000100:00100000:3.0:1788864879.514334:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+13:2358:x1875760528777216:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864879.514371:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+13:2358:x1875760528777216:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 38us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864879.514950:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 278 00000100:00100000:0.0:1788864879.528837:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864879.528915:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864879.529148:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528777472 00000100:00100000:1.0:1788864879.529162:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528777472 00000100:00100000:1.0:1788864879.529255:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1788864879.529267:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2355:x1875760528777472:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:1.0:1788864879.529319:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e959372 00000100:00080000:1.0:1788864879.529331:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9fdcbdc54000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788864879.529387:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1788864879.529779:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+2:2355:x1875760528777472:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 513us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864879.529789:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00010000:00010000:1.0:1788864879.529816:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788864879.530006:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788864879.531876:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528777600 00000100:00100000:3.0:1788864879.531890:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528777600 00000100:00100000:3.0:1788864879.531976:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:3.0:1788864879.531985:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528777600:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864879.532071:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528777600:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 88us (3155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864879.532093:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00080000:0.0:1788864879.532602:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788864880.198380:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864881.221954:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788864881.559404:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1cf2dd0f-7f2d-465e-9303-244222bc89bf 00000020:00000080:0.0:1788864881.559413:0:6709:0:(genops.c:885:class_export_put()) final put ffff9fdcbdc71800/1cf2dd0f-7f2d-465e-9303-244222bc89bf 00000020:00000080:2.0:1788864881.559473:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcbdc71800/1cf2dd0f-7f2d-465e-9303-244222bc89bf for lustre-OST0000 00000020:00000080:2.0:1788864881.559522:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fdcbdc54000 for lustre-OST0000 00000100:00100000:3.0:1788864881.996858:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546638080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788864881.996923:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864881.997115:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546638080 00000100:00100000:3.0:1788864881.997124:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546638080 00000100:00100000:3.0:1788864881.997177:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788864881.997186:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546638080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788864881.997219:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788864881.997264:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546638080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864881.997272:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1788864881.997291:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788864881.997323:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546638080:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788864882.248152:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788864882.438040:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788864883.024476:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546638592:0@lo:400:kworker.0 00000100:00100000:0.0:1788864883.024544:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864883.024597:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788864883.024604:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546638208:0@lo:400:kworker.0 00000100:00100000:0.0:1788864883.024632:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864883.024666:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875760546638720:0@lo:400:kworker.0 00000100:00100000:0.0:1788864883.024691:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864883.024770:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546638592 00000100:00100000:0.0:1788864883.024777:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546638592 00000100:00100000:0.0:1788864883.024829:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788864883.024839:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546638592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864883.024888:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546638592:12345-0@lo:400:kworker.0 Request processed in 50us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864883.024895:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788864883.024916:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546638208 00000100:00100000:0.0:1788864883.024919:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546638208 00000100:00100000:0.0:1788864883.024944:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788864883.024950:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3302:x1875760546638208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864883.024978:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3302:x1875760546638208:12345-0@lo:400:kworker.0 Request processed in 28us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864883.024985:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788864883.025022:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546638720 00000100:00100000:0.0:1788864883.025026:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546638720 00000100:00100000:0.0:1788864883.025051:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788864883.025058:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875760546638720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864883.025099:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875760546638720:12345-0@lo:400:kworker.0 Request processed in 42us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864883.025105:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1788864883.025128:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788864883.025132:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788864883.025161:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546638208:0@lo:400:kworker.0 00000100:00100000:0.0:1788864883.025172:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875760546638720:0@lo:400:kworker.0 00000100:00100000:0.0:1788864883.025180:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546638592:0@lo:400:kworker.0 00000100:00100000:1.0:1788864883.025464:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546638336:0@lo:400:kworker.0 00000100:00100000:1.0:1788864883.025496:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864883.025524:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546638848:0@lo:400:kworker.0 00000100:00100000:1.0:1788864883.025546:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864883.025574:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788864883.025581:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546638464:0@lo:400:kworker.0 00000100:00100000:1.0:1788864883.025603:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864883.025632:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546638336 00000100:00100000:1.0:1788864883.025636:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546638336 00000100:00100000:2.0:1788864883.025723:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546638848 00000100:00100000:2.0:1788864883.025735:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546638848 00000100:00100000:2.0:1788864883.025767:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788864883.025774:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546638848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864883.025812:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546638848:12345-0@lo:400:kworker.0 Request processed in 39us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864883.025818:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788864883.025935:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546638464 00000100:00100000:1.0:1788864883.025940:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546638464 00000100:00100000:1.0:1788864883.025960:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788864883.025966:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546638336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864883.025997:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546638336:12345-0@lo:400:kworker.0 Request processed in 31us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864883.026003:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788864883.026019:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788864883.026025:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc062b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546638464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864883.026049:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc062b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546638464:12345-0@lo:400:kworker.0 Request processed in 25us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864883.026061:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788864883.026098:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546638464:0@lo:400:kworker.0 00000100:00100000:1.0:1788864883.026107:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546638336:0@lo:400:kworker.0 00010000:00080000:1.0:1788864883.026117:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcc0629880 x1875760546638848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864883.026126:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546638848:0@lo:400:kworker.0 00000100:00080000:0.0:1788864883.026282:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788864883.026286:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788864883.268872:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864883.525540:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86ebaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546638976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788864883.525612:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864883.526285:0:10234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546638976 00000100:00100000:2.0:1788864883.526294:0:10234:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546638976 00000100:00100000:2.0:1788864883.526336:0:10234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788864883.526356:0:10234:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546638976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788864883.526391:0:10234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788864883.526443:0:10234:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546638976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864883.526450:0:10234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788864883.526490:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc86ebaa00 x1875760546638976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864883.526508:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86ebaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546638976:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788864884.292918:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864884.635957:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864884.635998:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864884.636023:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864884.636108:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528777728 00000100:00100000:1.0:1788864884.636114:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528777984 00000100:00100000:3.0:1788864884.636118:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528777728 00000100:00100000:1.0:1788864884.636120:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528777984 00000100:00100000:3.0:1788864884.636179:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 280 00000100:00100000:1.0:1788864884.636221:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528777856 00000100:00100000:1.0:1788864884.636226:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528777856 00000100:00100000:0.0:1788864884.636229:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:0.0:1788864884.636241:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2359:x1875760528777984:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864884.636259:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+13:2359:x1875760528777728:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864884.636344:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+13:2359:x1875760528777728:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 76us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864884.636353:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 280 00000100:00080000:2.0:1788864884.636734:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788864884.636982:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:1.0:1788864884.636990:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2359:x1875760528777856:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788864884.637102:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2359:x1875760528777856:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 112us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864884.637110:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:0.0:1788864884.637171:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2359:x1875760528777984:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 932us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864884.637179:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 118 00010000:00010000:2.0:1788864885.322984:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788864886.101444:0:11836:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 06:54:43 (1788864883) 00010000:00010000:0.0:1788864886.346832:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864887.108961:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788864887.108982:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546639104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788864887.109056:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864887.109194:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546639104 00000100:00100000:3.0:1788864887.109202:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546639104 00000100:00100000:3.0:1788864887.109268:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788864887.109277:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546639104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788864887.109316:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788864887.109372:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546639104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864887.109379:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788864887.109417:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546639104:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788864887.109866:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788864887.373757:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864888.133037:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc062ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875760546639488:0@lo:400:kworker.0 00000100:00100000:1.0:1788864888.133114:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864888.133174:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788864888.133181:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875760546639360:0@lo:400:kworker.0 00000100:00100000:1.0:1788864888.133202:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864888.133219:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546639872:0@lo:400:kworker.0 00000100:00100000:1.0:1788864888.133242:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864888.133275:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546639488 00000100:00100000:1.0:1788864888.133295:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546639488 00000100:00100000:1.0:1788864888.133347:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546639360 00000100:00100000:1.0:1788864888.133350:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546639360 00000100:00100000:1.0:1788864888.133372:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788864888.133382:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875760546639488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864888.133840:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546639872 00000100:00100000:0.0:1788864888.133845:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546639872 00000100:00100000:0.0:1788864888.133884:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788864888.133890:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc062a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546639872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864888.134011:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875760546639488:12345-0@lo:400:kworker.0 Request processed in 630us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864888.134020:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788864888.134048:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788864888.134056:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc062a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875760546639360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864888.134098:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546639232:0@lo:400:kworker.0 00000100:00100000:2.0:1788864888.134158:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546639616:0@lo:400:kworker.0 00000100:00100000:0.0:1788864888.138101:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc062a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546639872:12345-0@lo:400:kworker.0 Request processed in 4200us (4847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864888.138116:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1788864888.138230:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788864888.138235:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788864888.138274:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdcc0628700 x1875760546639872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864888.138289:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546639872:0@lo:400:kworker.0 00000100:00100000:0.0:1788864888.138302:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc062ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875760546639488:0@lo:400:kworker.0 00000100:00100000:1.0:1788864888.138788:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc062a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875760546639360:12345-0@lo:400:kworker.0 Request processed in 4730us (5581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864888.138798:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788864888.138923:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875760546639360:0@lo:400:kworker.0 00000100:00100000:3.0:1788864888.140553:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864888.140611:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875760546639744:0@lo:400:kworker.0 00000100:00100000:3.0:1788864888.140650:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864888.140886:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546639744 00000100:00100000:1.0:1788864888.140895:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546639744 00000100:00100000:1.0:1788864888.140964:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788864888.140973:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875760546639744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864888.141028:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875760546639744:12345-0@lo:400:kworker.0 Request processed in 57us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864888.141035:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788864888.142958:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546639232 00000100:00100000:0.0:1788864888.142971:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546639232 00000100:00100000:0.0:1788864888.143026:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788864888.143035:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3303:x1875760546639232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864888.143119:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3303:x1875760546639232:12345-0@lo:400:kworker.0 Request processed in 85us (2570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864888.143126:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:3.0:1788864888.144902:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864888.144950:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546639232:0@lo:400:kworker.0 00000100:00100000:3.0:1788864888.144970:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875760546639744:0@lo:400:kworker.0 00000100:00100000:2.0:1788864888.148927:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864888.149084:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546639616 00000100:00100000:1.0:1788864888.149093:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546639616 00000100:00100000:1.0:1788864888.149149:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788864888.149159:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546639616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864888.149222:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546639616:12345-0@lo:400:kworker.0 Request processed in 64us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864888.149229:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788864888.150805:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546639616:0@lo:400:kworker.0 00010000:00010000:2.0:1788864888.388929:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864888.645668:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788864888.645694:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546640000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788864888.645791:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864888.645971:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546640000 00000100:00100000:1.0:1788864888.645979:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546640000 00000100:00100000:1.0:1788864888.646055:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788864888.646065:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546640000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788864888.646101:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788864888.646154:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546640000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864888.646162:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1788864888.646235:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc86eb8e00 x1875760546640000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864888.646255:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546640000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788864888.692082:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864888.692147:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528778112 00000100:00100000:0.0:1788864888.692157:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528778112 00000100:00100000:0.0:1788864888.692228:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:0.0:1788864888.692240:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc062b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:10262:x1875760528778112:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788864888.692267:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864888.692311:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497400/0xf8c13e2d0e95943d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975faf5 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.692377:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81496800/0xf8c13e2d0e959444 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.692390:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81496800/0xf8c13e2d0e959444 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.692405:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81496800/0xf8c13e2d0e959444 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864888.692439:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788864888.692442:0:6705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788864888.692480:0:6705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81496800/0xf8c13e2d0e959444 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.692504:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497400/0xf8c13e2d0e95943d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975faf5 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.692524:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81496800/0xf8c13e2d0e959444 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975faf5 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.692532:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdca4f57f00) 00010000:00010000:0.0:1788864888.692535:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788864888.692538:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdc81496800, rc 0) 00000100:00100000:0.0:1788864888.692600:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc062b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:10262:x1875760528778112:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 363us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864888.692607:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00080000:3.0:1788864888.692737:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864888.708504:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864888.708671:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528778240 00000100:00100000:1.0:1788864888.708680:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528778240 00000100:00100000:1.0:1788864888.708857:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:1.0:1788864888.708867:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:10263:x1875760528778240:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788864888.708927:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864888.708995:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e95944b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fafc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709062:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959452 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709075:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959452 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709086:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959452 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709098:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959459 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709105:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709123:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709298:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74e00/0xf8c13e2d0e959460 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709306:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74e00/0xf8c13e2d0e959460 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709313:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74e00/0xf8c13e2d0e959460 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864888.709336:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788864888.709339:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788864888.709356:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74e00/0xf8c13e2d0e959460 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709365:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959452 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709372:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959452 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709379:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959452 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709472:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864888.709477:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959452 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709485:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959452 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709502:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdca4f57f00) 00010000:00010000:1.0:1788864888.709504:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864888.709509:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959452 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709515:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959452 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709527:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709533:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959459 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709625:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959459 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709632:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864888.709635:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959459 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709642:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959459 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709650:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9fdc8328ed00) 00010000:00010000:1.0:1788864888.709652:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864888.709655:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959459 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709661:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959459 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709736:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e95944b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fafc expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709749:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74e00/0xf8c13e2d0e959460 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fafc expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864888.709757:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fdc8328e400) 00010000:00010000:1.0:1788864888.710096:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788864888.710100:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc74e00, rc 0) 00000100:00100000:1.0:1788864888.710193:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:10263:x1875760528778240:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1327us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864888.710201:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:1.0:1788864888.728406:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864888.729447:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528778496 00000100:00100000:2.0:1788864888.729457:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528778496 00000100:00100000:0.0:1788864888.729558:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:0.0:1788864888.729581:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc062aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:10263:x1875760528778496:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788864888.729601:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864888.729620:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497400/0xf8c13e2d0e959467 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fb03 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.729699:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e95946e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.729748:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e95946e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.729824:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e95946e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.729883:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959475 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.729891:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959475 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.729898:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959475 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.730204:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4bc00/0xf8c13e2d0e95947c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.730213:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4bc00/0xf8c13e2d0e95947c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.730220:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4bc00/0xf8c13e2d0e95947c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864888.730239:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788864888.730372:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e95946e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.730380:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e95946e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.730387:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e95946e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.730393:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4aa00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864888.730397:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e95946e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.730589:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e95946e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.730601:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fdc8328e400) 00010000:00010000:0.0:1788864888.730604:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864888.730608:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e95946e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.730615:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e95946e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.730628:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959475 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.730634:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959475 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.730649:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959475 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.730654:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864888.730657:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959475 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.730662:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959475 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.730669:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fdca4f57d00) 00010000:00010000:0.0:1788864888.730672:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864888.730674:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959475 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.730680:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959475 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.731203:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81497400/0xf8c13e2d0e959467 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb03 expref: 10 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.731219:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4bc00/0xf8c13e2d0e95947c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb03 expref: 9 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864888.731227:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fdca4f57c00) 00010000:00010000:0.0:1788864888.731229:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864888.731232:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4bc00, rc 0) 00000100:00100000:0.0:1788864888.731295:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc062aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:10263:x1875760528778496:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1717us (2897us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788864888.731314:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:2.0:1788864888.752920:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864888.757483:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528778624 00000100:00100000:1.0:1788864888.757499:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528778624 00000100:00100000:1.0:1788864888.757718:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:1.0:1788864888.757731:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:10263:x1875760528778624:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788864888.757879:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:10263:x1875760528778624:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 Request processed in 122us (4938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864888.759182:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00010000:00010000:1.0:1788864889.416297:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788864889.606581:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788864889.756185:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864889.756230:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864889.756263:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528778880 00000100:00100000:3.0:1788864889.756273:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528778880 00000100:00100000:3.0:1788864889.756322:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:3.0:1788864889.756332:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:2359:x1875760528778880:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864889.756405:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:2359:x1875760528778880:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 74us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864889.756420:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:2.0:1788864889.756874:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528778752 00000100:00100000:2.0:1788864889.756880:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528778752 00000100:00100000:2.0:1788864889.756911:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 282 00000100:00100000:2.0:1788864889.756919:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:2358:x1875760528778752:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788864889.757220:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:2358:x1875760528778752:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 301us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864889.757227:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 282 00000100:00100000:3.0:1788864889.765262:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864889.765348:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528779008 00000100:00100000:0.0:1788864889.765358:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528779008 00000100:00100000:0.0:1788864889.765433:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:0.0:1788864889.765445:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528779008:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788864889.765528:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528779008:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 85us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864889.765536:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00080000:3.0:1788864889.765691:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788864890.443486:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864891.461844:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864891.490254:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864891.490344:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528779136 00000100:00100000:0.0:1788864891.490354:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528779136 00000100:00100000:0.0:1788864891.490424:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:0.0:1788864891.490435:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:10306:x1875760528779136:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788864891.490452:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864891.490470:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e95948a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fb0a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.490541:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e959491 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.490557:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e959491 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.490568:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e959491 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.490583:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959498 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.490600:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959498 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.490608:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959498 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.490816:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e959491 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.490824:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e959491 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.490847:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e959491 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.490853:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864891.490857:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e959491 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.490864:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e959491 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.490875:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdca4f57f00) 00010000:00010000:0.0:1788864891.491193:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864891.491199:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e959491 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.491206:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e959491 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.491218:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959498 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.491231:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959498 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.491238:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959498 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.491243:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864891.491246:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959498 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.491253:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959498 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.491261:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fdca4f57700) 00010000:00010000:0.0:1788864891.491264:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864891.491268:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959498 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.491274:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959498 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.491309:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e95948a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb0a expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.491320:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdca4f57f00) 00010000:00010000:0.0:1788864891.491323:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864891.491326:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e95948a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb0a expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.491336:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4b800, rc 0) 00000100:00100000:0.0:1788864891.491400:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:10306:x1875760528779136:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 968us (1155us total) trans 0 rc 301/301 00000100:00100000:0.0:1788864891.491408:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00080000:3.0:1788864891.492322:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788864891.495227:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864891.495358:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528779392 00000100:00100000:1.0:1788864891.495367:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528779392 00000100:00100000:1.0:1788864891.495418:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:1.0:1788864891.495427:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:10306:x1875760528779392:12345-192.168.203.13@tcp:36:lfs.0 00010000:00010000:1.0:1788864891.495487:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864891.495510:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdc81496800/0xf8c13e2d0e959444 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975faf5 expref: 9 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.495535:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdca4f57f00) 00010000:00010000:1.0:1788864891.495545:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788864891.495751:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95949f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.495764:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95949f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.495774:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95949f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.495785:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9594a6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.495792:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9594a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.495799:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9594a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864891.500441:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788864891.500461:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95949f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.500471:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95949f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.500479:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95949f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.500491:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864891.500495:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95949f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.500503:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95949f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.502405:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc8328ed00) 00010000:00010000:1.0:1788864891.502413:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864891.502420:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95949f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.502429:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95949f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788864891.502455:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000dab3e74 reply state 00000000dc41696a transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9594a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864891.502465:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788864891.506159:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+10:10306:x1875760528779392:12345-192.168.203.13@tcp:36:lfs.0 Request processed in 10722us (10929us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788864891.506172:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00010000:00010000:1.0:1788864891.513615:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9594a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.513631:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9594a6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.513639:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9594a6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.513656:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864891.513661:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9594a6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.513668:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9594a6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.513684:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fdc8328e500) 00010000:00010000:1.0:1788864891.513688:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864891.513692:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9594a6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.513699:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9594a6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864891.724790:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864891.725735:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528779520 00000100:00100000:0.0:1788864891.725744:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528779520 00000100:00100000:0.0:1788864891.725794:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:0.0:1788864891.725804:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:10314:x1875760528779520:12345-192.168.203.13@tcp:101:lctl.0 00010000:00010000:0.0:1788864891.725824:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864891.725844:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e9594ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fb11 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.725903:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e9594b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.725918:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e9594b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.725930:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e9594b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864891.725963:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788864891.725966:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788864891.726003:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e9594b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.726038:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e9594ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb11 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.726068:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e9594b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb11 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864891.726077:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdca4f57300) 00010000:00010000:0.0:1788864891.726080:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788864891.726084:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4a400, rc 0) 00000100:00100000:0.0:1788864891.726142:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+10:10314:x1875760528779520:12345-192.168.203.13@tcp:101:lctl.0 Request processed in 339us (1359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864891.726149:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000001:00080000:1.0:1788864891.823036:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000001:00080000:1.0:1788864891.823053:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000100:00100000:1.0:1788864891.823643:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864891.824486:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528779648 00000100:00100000:0.0:1788864891.824496:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528779648 00000100:00100000:1.0:1788864891.824766:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:1.0:1788864891.824778:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:10320:x1875760528779648:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788864891.824796:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864891.824815:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9594bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fb18 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.824883:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9594c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.824898:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9594c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.824921:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9594c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.825135:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9594c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.825144:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9594c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.825152:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9594c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.825399:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e9594d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.825408:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e9594d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.825416:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e9594d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864891.825441:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788864891.825445:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788864891.825482:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e9594d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.825493:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9594c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.825499:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9594c2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.825514:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9594c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.825650:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864891.825654:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9594c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.825661:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9594c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.825673:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdca4f57300) 00010000:00010000:1.0:1788864891.825676:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864891.825681:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9594c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.825687:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9594c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.825699:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9594c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.825815:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9594c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.825821:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9594c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.825826:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864891.825829:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9594c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.825844:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9594c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.825854:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fdc8328ed00) 00010000:00010000:1.0:1788864891.825856:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864891.825859:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9594c9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.825864:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9594c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.825896:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9594bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb18 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.825910:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e9594d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb18 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.825917:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:1.0:1788864891.825919:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788864891.825922:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc75e00, rc 0) 00000100:00100000:1.0:1788864891.825992:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:10320:x1875760528779648:12345-192.168.203.13@tcp:101:bash.0 Request processed in 1216us (2353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864891.826001:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:0.0:1788864891.841407:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864891.841739:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528779904 00000100:00100000:2.0:1788864891.841749:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528779904 00000100:00100000:2.0:1788864891.841799:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:2.0:1788864891.841809:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:10320:x1875760528779904:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1788864891.841829:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864891.841848:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e9594d7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fb1f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864891.842193:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e9594de lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864891.842213:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e9594de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864891.842225:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e9594de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864891.842265:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9594e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864891.842273:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9594e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864891.842279:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9594e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788864891.844094:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788864891.844409:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9594ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864891.844422:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9594ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864891.844432:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9594ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864891.844578:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e9594de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864891.844586:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e9594de lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864891.844592:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e9594de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864891.844605:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864891.844609:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e9594de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864891.844616:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e9594de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864891.844628:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:2.0:1788864891.844631:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864891.844635:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e9594de lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864891.844700:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e9594de lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788864891.844799:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a9f687e reply state 0000000055d130d9 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9594e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864891.844807:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788864891.844841:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e9594d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb1f expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864891.844855:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9594ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb1f expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864891.844863:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:2.0:1788864891.844865:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788864891.844867:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385a00, rc 0) 00000100:00100000:2.0:1788864891.845122:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+12:10320:x1875760528779904:12345-192.168.203.13@tcp:101:bash.0 Request processed in 3313us (3722us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788864891.845137:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00010000:00010000:3.0:1788864891.852291:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9594e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864891.852309:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9594e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864891.852317:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9594e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864891.852323:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864891.852328:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9594e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864891.852336:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9594e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864891.852353:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fdc9124e200) 00010000:00010000:3.0:1788864891.852357:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864891.852362:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9594e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864891.852368:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9594e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864891.856546:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864891.856638:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528780032 00000100:00100000:2.0:1788864891.856660:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528780032 00000100:00100000:2.0:1788864891.856748:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:2.0:1788864891.856756:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1875760528780032:12345-192.168.203.13@tcp:8:bash.0 00010000:00080000:2.0:1788864891.856785:0:6685:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:2.0:1788864891.856815:0:6685:0:(genops.c:1384:class_connect()) connect: client 1cf2dd0f-7f2d-465e-9303-244222bc89bf, cookie 0xf8c13e2d0e9594fa 00002000:00100000:2.0:1788864891.856826:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1cf2dd0f-7f2d-465e-9303-244222bc89bf/ffff9fdc82ac3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788864891.856849:0:6685:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788864891.857109:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788864891.857138:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9fdc82ac3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788864891.857200:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2355:x1875760528780032:12345-192.168.203.13@tcp:8:bash.0 Request processed in 443us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864891.857208:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:0.0:1788864891.872506:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864891.872859:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528780160 00000100:00100000:1.0:1788864891.872868:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528780160 00000100:00100000:1.0:1788864891.872957:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:1.0:1788864891.872967:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:0:x1875760528780160:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788864891.873000:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864891.873031:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c89bc6b/0xf8c13e2d0e959501 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fb26 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788864891.873057:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788864891.873075:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=315s v=(0 0) 00010000:00010000:1.0:1788864891.873079:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864891.873087:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c89bc6b/0xf8c13e2d0e959501 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb26 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.873104:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c89bc6b/0xf8c13e2d0e959501 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb26 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.873117:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc74c00, rc 0) 00000100:00100000:1.0:1788864891.873177:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:0:x1875760528780160:12345-192.168.203.13@tcp:101:bash.0 Request processed in 212us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864891.873184:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00080000:3.0:1788864891.873305:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788864891.885970:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864891.886110:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528780288 00000100:00100000:2.0:1788864891.886121:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528780288 00000100:00100000:2.0:1788864891.886176:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:2.0:1788864891.886186:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc062b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:10320:x1875760528780288:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1788864891.886203:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864891.886224:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e959508 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fb2d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864891.886254:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c89bc6b/0xf8c13e2d0e959501 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb26 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864891.886281:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864891.886285:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864891.886290:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e959508 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb2d expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864891.886326:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c89bc6b/0xf8c13e2d0e959501 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb26 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864891.886340:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c89bc6b/0xf8c13e2d0e959501 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb26 expref: 8 pid: 6682 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864891.886354:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86ebad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1875760546640128:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788864891.886460:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc90902240 going to sleep for 11 seconds 00000100:00100000:0.0:1788864891.889413:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864891.889658:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528780416 00000100:00100000:1.0:1788864891.889666:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528780416 00010000:00010000:1.0:1788864891.889738:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c89bc6b/0xf8c13e2d0e959501 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb26 expref: 9 pid: 6682 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864891.889769:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:1.0:1788864891.889778:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:2358:x1875760528780416:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864891.889791:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864891.889823:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c89bc6b/0xf8c13e2d0e959501 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb26 expref: 9 pid: 6682 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.889848:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c89bc6b/0xf8c13e2d0e959501 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb26 expref: 9 pid: 6682 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.889871:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864891.889876:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864891.889883:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e959508 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb2d expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.889895:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e959508 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb2d expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864891.889928:0:5821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e959508 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb2d expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864891.890008:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc062bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5821:1875760546640256:192.168.203.13@tcp:105: 00000100:00100000:1.0:1788864891.890177:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca8d28300 going to sleep for 11 seconds 00010000:00010000:2.0:1788864891.890439:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c89bc6b/0xf8c13e2d0e959501 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb26 expref: 9 pid: 6682 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864891.890455:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86ebad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1875760546640128:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788864891.890480:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e959508 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb2d expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864891.890490:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385200, rc 0) 00000100:00100000:2.0:1788864891.890534:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc062b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:10320:x1875760528780288:12345-192.168.203.13@tcp:101:bash.0 Request processed in 4339us (4562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864891.890552:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:0.0:1788864891.897794:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864891.897867:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528780672 00000100:00100000:2.0:1788864891.897885:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528780672 00000100:00100000:2.0:1788864891.897944:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:2.0:1788864891.897954:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+11:10320:x1875760528780672:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:2.0:1788864891.898281:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+12:10320:x1875760528780672:12345-192.168.203.13@tcp:35:bash.0 Request processed in 327us (494us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788864891.898289:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1788864891.902403:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc062bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5821:1875760546640256:192.168.203.13@tcp:105: 00010000:00010000:1.0:1788864891.902430:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864891.902541:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2358:x1875760528780416:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 12763us (13133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864891.902550:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:0.0:1788864892.037613:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864892.037750:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528780928 00000100:00100000:2.0:1788864892.037758:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528780928 00000100:00100000:2.0:1788864892.037820:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:2.0:1788864892.037831:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbba7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+12:10330:x1875760528780928:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788864892.037856:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864892.037886:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95950f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fb34 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864892.037970:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788864892.038098:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95950f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb34 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.038111:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdca4f57300) 00010000:00010000:2.0:1788864892.038114:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788864892.038119:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95950f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb34 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.038132:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384000, rc 0) 00000100:00100000:2.0:1788864892.038202:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbba7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+13:10330:x1875760528780928:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 373us (598us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788864892.038209:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:3.0:1788864892.042261:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864892.042494:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528781184 00000100:00100000:2.0:1788864892.042505:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528781184 00000100:00100000:2.0:1788864892.042569:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1788864892.042580:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+13:10330:x1875760528781184:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788864892.042845:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+14:10330:x1875760528781184:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 266us (591us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788864892.042853:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:0.0:1788864892.172560:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864892.172735:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528781312 00000100:00100000:2.0:1788864892.172745:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528781312 00000100:00100000:2.0:1788864892.172801:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:2.0:1788864892.172812:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbba7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+14:10336:x1875760528781312:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788864892.172853:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864892.172873:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95951d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fb3b expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.172946:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959524 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.172958:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.172971:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864892.173004:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788864892.173032:0:6705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788864892.173054:0:6705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.173081:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95951d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb3b expref: 16 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.173099:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb3b expref: 15 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.173108:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:2.0:1788864892.173111:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788864892.173116:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385800, rc 0) 00000100:00100000:2.0:1788864892.173173:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbba7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+15:10336:x1875760528781312:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 363us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864892.173180:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:1.0:1788864892.177373:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864892.177735:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528781568 00000100:00100000:0.0:1788864892.177744:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528781568 00000100:00100000:0.0:1788864892.177796:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:0.0:1788864892.177806:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc062bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+15:10336:x1875760528781568:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788864892.177825:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864892.177856:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e95952b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fb42 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864892.177968:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959532 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864892.177983:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864892.177993:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864892.178002:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788864892.178139:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e95952b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb42 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864892.178159:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959532 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb42 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864892.178167:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:0.0:1788864892.178170:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788864892.178174:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4b400, rc 0) 00000100:00100000:0.0:1788864892.178230:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc062bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+17:10336:x1875760528781568:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 425us (865us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788864892.178238:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:3.0:1788864892.183769:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864892.183809:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864892.183970:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528781824 00000100:00100000:2.0:1788864892.183979:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528781824 00000100:00100000:2.0:1788864892.184037:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:2.0:1788864892.184047:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+17:10336:x1875760528781824:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788864892.184074:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864892.184096:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959540 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fb49 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.184191:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959547 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.184205:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959547 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.184235:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959547 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864892.184250:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788864892.184375:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959540 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb49 expref: 20 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.184394:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959547 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb49 expref: 19 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.184402:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:2.0:1788864892.184405:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788864892.184408:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385600, rc 0) 00000100:00100000:2.0:1788864892.184467:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+19:10336:x1875760528781824:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 421us (707us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788864892.184474:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:1.0:1788864892.185114:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528781952 00000100:00100000:1.0:1788864892.185125:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528781952 00000100:00100000:1.0:1788864892.185174:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:1.0:1788864892.185183:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+19:2356:x1875760528781952:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864892.185194:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864892.185210:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959532 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb42 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864892.185223:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:1.0:1788864892.185228:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864892.185253:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+18:2356:x1875760528781952:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 72us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864892.185260:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:3.0:1788864892.204840:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864892.205159:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528782080 00000100:00100000:1.0:1788864892.205168:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528782080 00000100:00100000:1.0:1788864892.205221:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:1.0:1788864892.205230:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2358:x1875760528782080:12345-192.168.203.13@tcp:1:lfs.0 00010000:00010000:1.0:1788864892.205271:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959555 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864892.205290:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e959508 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb2d expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864892.205309:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864892.205313:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788864892.205317:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959555 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864892.205371:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e959508 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb2d expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864892.205386:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e959508 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb2d expref: 7 pid: 6685 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864892.205400:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0629f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1875760546640384:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788864892.205494:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca8d28300 going to sleep for 11 seconds 00000100:00100000:1.0:1788864892.212743:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0629f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1875760546640384:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788864892.212777:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959555 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864892.220294:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864892.220559:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528782208 00000100:00100000:2.0:1788864892.220569:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528782208 00002000:00100000:2.0:1788864892.220615:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9fdcbc7e0a80 x1875760528782208/t0(0) o4->1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp:368/0 lens 504/0 e 0 to 0 dl 1788864903 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788864892.220625:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fdcbc7e0a80 with x1875760528782208 ext(0->12) 00010000:00010000:2.0:1788864892.220635:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e959508 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb2d expref: 8 pid: 6685 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.220652:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e959508 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb2d expref: 8 pid: 6685 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788864892.220679:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fdcbc7e0a80 00000100:00100000:2.0:1788864892.220745:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:2.0:1788864892.220755:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2359:x1875760528782208:12345-192.168.203.13@tcp:4:lfs.0 00000100:00100000:1.0:1788864892.229114:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788864892.229137:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546640512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788864892.229203:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864892.229330:0:10234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546640512 00000100:00100000:3.0:1788864892.229338:0:10234:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546640512 00000100:00100000:3.0:1788864892.229404:0:10234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788864892.229414:0:10234:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546640512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788864892.229447:0:10234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788864892.229496:0:10234:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546640512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864892.229503:0:10234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788864892.229557:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546640512:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788864892.229688:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1788864892.278952:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1cf2dd0f-7f2d-465e-9303-244222bc89bf 00000100:00100000:2.0:1788864892.283837:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:2359:x1875760528782208:12345-192.168.203.13@tcp:4:lfs.0 Request processed in 63075us (63544us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788864892.283852:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00002000:00100000:2.0:1788864892.283865:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9fdcbc7e0a80 x1875760528782208/t4294967299(0) o4->1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp:368/0 lens 504/448 e 0 to 0 dl 1788864903 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788864892.284116:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fdcbc7e0a80 with x1875760528782208 ext(0->12) 00010000:00010000:2.0:1788864892.284128:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e959508 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb2d expref: 9 pid: 6685 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.284146:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e959508 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb2d expref: 9 pid: 6685 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788864892.284154:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fdcbc7e0a80 00000100:00100000:0.0:1788864892.286850:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864892.286937:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528782336 00000100:00100000:1.0:1788864892.286946:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528782336 00010000:00010000:1.0:1788864892.286982:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e959508 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb2d expref: 9 pid: 6685 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864892.287032:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:1.0:1788864892.287043:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbba7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:2358:x1875760528782336:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864892.287056:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788864892.287073:0:5821:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788864892.287088:0:5821:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788864891 00002000:00010000:1.0:1788864892.287091:0:5821:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788864891 00002000:00010000:1.0:1788864892.287093:0:5821:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788864891 00010000:00010000:1.0:1788864892.287099:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e959508 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb2d expref: 9 pid: 6685 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864892.287113:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e959508 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb2d expref: 9 pid: 6685 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864892.287133:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e959508 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb2d expref: 9 pid: 6685 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864892.287150:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788864892.287154:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788864892.287159:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959555 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864892.287169:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959555 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864892.287202:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864892.287255:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbba7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2358:x1875760528782336:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 214us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864892.287263:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00010000:00010000:0.0:1788864892.287322:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959555 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864892.287331:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959555 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864892.287360:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959555 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864892.287368:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959555 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864892.287375:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959555 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864892.287381:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74000 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788864892.287384:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959555 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864892.287392:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959555 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864892.287405:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959555 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864892.287412:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959555 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864892.287456:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2358:x1875760528782080:12345-192.168.203.13@tcp:1:lfs.0 Request processed in 82228us (82624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864892.287465:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:1.0:1788864892.289630:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864892.289731:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528782592 00000100:00100000:2.0:1788864892.289739:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528782592 00000100:00100000:2.0:1788864892.289787:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:2.0:1788864892.289797:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+18:10336:x1875760528782592:12345-192.168.203.13@tcp:35:lfs.0 00000004:00010000:2.0:1788864892.289856:0:5838:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959547 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb49 expref: 18 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788864892.290140:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1788864892.290195:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788864892.290661:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788864892.290727:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95955c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.290740:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9594ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb1f expref: 22 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.290749:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95955c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.290779:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9594ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb1f expref: 22 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.290793:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9594ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb1f expref: 22 pid: 5835 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864892.290805:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86ebad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5838:1875760546640640:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788864892.290881:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc83366600 going to sleep for 11 seconds 00000100:00100000:1.0:1788864892.293419:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86ebad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5838:1875760546640640:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788864892.293442:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95955c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864892.296278:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864892.296361:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528782720 00000100:00100000:2.0:1788864892.296370:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528782720 00010000:00010000:2.0:1788864892.296407:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9594ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb1f expref: 23 pid: 5835 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864892.296445:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:2.0:1788864892.296455:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0629880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+23:2359:x1875760528782720:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788864892.296482:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864892.296490:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9594ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb1f expref: 23 pid: 5835 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.296502:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9594ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb1f expref: 23 pid: 5835 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.296528:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9594ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb1f expref: 23 pid: 5835 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.296542:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:2.0:1788864892.296547:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95955c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.296556:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95955c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.296563:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95955c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.296596:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864892.296650:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0629880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+22:2359:x1875760528782720:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 196us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864892.296657:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00010000:00010000:3.0:1788864892.296845:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95955c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864892.296854:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95955c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788864892.296977:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788864892.297178:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1788864892.297297:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5838:1875760546640768:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788864892.297342:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864892.297365:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbc4ff240 going to sleep for 11 seconds 00000100:00100000:0.0:1788864892.297639:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546640768 00000100:00100000:0.0:1788864892.297645:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546640768 00000100:00100000:0.0:1788864892.297687:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788864892.297695:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc063bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1875760546640768:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788864892.297783:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc063bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1875760546640768:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 89us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864892.297790:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788864892.298028:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788864892.298059:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5838:1875760546640768:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788864892.298614:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1788864892.298670:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc063aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5838:1875760546640896:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788864892.300140:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864892.300300:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbc4ffc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788864892.305118:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546640896 00000100:00100000:0.0:1788864892.305133:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546640896 00000100:00100000:1.0:1788864892.305274:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788864892.305284:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc063b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1875760546640896:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788864892.305553:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc063b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5838:x1875760546640896:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 269us (6847us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788864892.305560:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788864892.305648:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc063aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5838:1875760546640896:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788864892.305751:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1788864892.305795:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95955c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864892.305806:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95955c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864892.305813:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95955c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864892.305819:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864892.305825:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95955c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864892.305833:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95955c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864892.305847:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:3.0:1788864892.305850:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788864892.305855:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95955c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864892.305861:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95955c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788864892.306058:0:5838:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788864892.306283:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788864892.306294:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 315437589835ns, next at 316437587575ns, rc = 0 00000001:00080000:3.0:1788864892.306301:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1788864892.306335:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:3.0:1788864892.306338:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788864892.306345:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959547 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb49 expref: 26 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864892.306433:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+25:10336:x1875760528782592:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 16637us (16808us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788864892.306442:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000020:00080000:3.0:1788864892.306445:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788864892.309664:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864892.309806:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528782848 00000100:00100000:0.0:1788864892.309816:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528782848 00000100:00100000:0.0:1788864892.309869:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:0.0:1788864892.309888:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0638000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+25:10336:x1875760528782848:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788864892.309912:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864892.309932:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959563 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fb50 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864892.310081:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959563 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb50 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864892.310096:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959563 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb50 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864892.310115:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:0.0:1788864892.310118:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788864892.310122:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4b400, rc 0) 00000100:00100000:0.0:1788864892.310177:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0638000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+26:10336:x1875760528782848:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 292us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864892.310200:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:0.0:1788864892.315786:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864892.315869:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528783104 00000100:00100000:3.0:1788864892.315884:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528783104 00000100:00100000:3.0:1788864892.315931:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:3.0:1788864892.315941:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb1038c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+26:10336:x1875760528783104:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1788864892.316166:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb1038c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+27:10336:x1875760528783104:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 226us (387us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1788864892.316173:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:1.0:1788864892.428424:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864892.428538:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528783360 00000100:00100000:2.0:1788864892.428548:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528783360 00000100:00100000:2.0:1788864892.428608:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:2.0:1788864892.428618:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+27:10346:x1875760528783360:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788864892.428654:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864892.428676:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e95956a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fb57 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864892.428795:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788864892.428924:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e95956a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb57 expref: 29 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.428938:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdca4f57300) 00010000:00010000:2.0:1788864892.428941:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788864892.428945:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e95956a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb57 expref: 29 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.428959:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385a00, rc 0) 00000100:00100000:2.0:1788864892.429028:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+28:10346:x1875760528783360:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 412us (615us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1788864892.429035:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:1.0:1788864892.434697:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864892.434857:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528783488 00000100:00100000:2.0:1788864892.434868:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528783488 00000100:00100000:2.0:1788864892.434934:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:2.0:1788864892.434945:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc062ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+28:10346:x1875760528783488:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:2.0:1788864892.435043:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959578 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435059:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959578 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435071:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959578 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435100:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95957f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435108:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95957f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435115:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95957f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435198:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959586 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435206:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959586 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435212:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959586 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788864892.435252:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959586 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435264:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959578 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435269:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959578 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435277:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959578 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435283:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864892.435288:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959578 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435302:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959578 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435313:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:2.0:1788864892.435316:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864892.435322:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959578 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435328:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959578 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435341:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95957f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435345:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95957f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435350:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95957f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435354:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864892.435356:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95957f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435361:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95957f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435368:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fdc9124e500) 00010000:00010000:2.0:1788864892.435370:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864892.435373:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95957f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435389:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95957f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435404:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959586 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435410:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959586 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435416:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959586 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435421:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864892.435424:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959586 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435429:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959586 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435437:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:2.0:1788864892.435439:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864892.435442:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959586 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.435449:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959586 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864892.435896:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc062ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+28:10346:x1875760528783488:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 951us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864892.435904:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:3.0:1788864892.445800:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864892.446353:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528783744 00000100:00100000:0.0:1788864892.446363:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528783744 00000100:00100000:0.0:1788864892.446422:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:0.0:1788864892.446432:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc063a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+28:10346:x1875760528783744:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1788864892.446666:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc063a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+29:10346:x1875760528783744:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 235us (874us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788864892.446674:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00010000:00010000:1.0:1788864892.484999:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864892.517912:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864892.518067:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528784000 00000100:00100000:2.0:1788864892.518078:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528784000 00000100:00100000:2.0:1788864892.518142:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:2.0:1788864892.518152:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+29:10349:x1875760528784000:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788864892.518174:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864892.518210:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e95958d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fb5e expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.518281:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959594 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.518294:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959594 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.518305:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959594 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.518317:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e95959b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.518324:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e95959b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.518330:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e95959b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.518436:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e9595a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.518444:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e9595a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.518468:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e9595a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864892.518478:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788864892.518577:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959594 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.518585:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959594 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.518593:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959594 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.518598:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864892.518602:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959594 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.518609:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959594 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.518621:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:2.0:1788864892.518624:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864892.518629:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959594 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.518635:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959594 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.518649:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e95959b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.518655:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e95959b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.518667:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e95959b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.518673:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864892.518676:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e95959b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.518682:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e95959b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.518690:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fdc9124e500) 00010000:00010000:2.0:1788864892.518692:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864892.518696:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e95959b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.518701:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e95959b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.518789:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e95958d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb5e expref: 32 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.518803:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e9595a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb5e expref: 31 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.518810:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:2.0:1788864892.518812:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788864892.518815:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385e00, rc 0) 00000100:00100000:2.0:1788864892.519046:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+31:10349:x1875760528784000:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 727us (973us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788864892.519063:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:1.0:1788864892.524894:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864892.525029:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528784128 00000100:00100000:0.0:1788864892.525039:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528784128 00000100:00100000:0.0:1788864892.525091:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:0.0:1788864892.525101:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+31:10349:x1875760528784128:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:0.0:1788864892.525167:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e9595b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864892.525200:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e9595b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864892.525212:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e9595b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864892.525234:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e9595b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864892.525241:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e9595b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864892.525265:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e9595b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864892.525270:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4ae00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864892.525274:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e9595b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864892.525281:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e9595b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864892.525293:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:0.0:1788864892.525296:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788864892.525301:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e9595b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864892.525307:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e9595b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864892.525374:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+31:10349:x1875760528784128:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 273us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864892.525381:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:1.0:1788864892.528336:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864892.528630:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528784384 00000100:00100000:0.0:1788864892.528639:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528784384 00000100:00100000:0.0:1788864892.528689:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1788864892.528698:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+31:10349:x1875760528784384:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1788864892.529829:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+32:10349:x1875760528784384:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 1129us (1497us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788864892.529839:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000040:00080000:2.0:1788864892.679639:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788864892.989308:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864892.989396:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528784640 00000100:00100000:2.0:1788864892.989407:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528784640 00000100:00100000:2.0:1788864892.989467:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:2.0:1788864892.989487:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+32:10380:x1875760528784640:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:2.0:1788864892.989510:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864892.989540:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e9595b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fb65 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.989631:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9595be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.989644:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9595be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.989656:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9595be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864892.989667:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788864892.989826:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e9595b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb65 expref: 35 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.989845:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9595be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb65 expref: 34 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864892.989854:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:2.0:1788864892.989856:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788864892.989866:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385a00, rc 0) 00000100:00100000:2.0:1788864892.990094:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+34:10380:x1875760528784640:12345-192.168.203.13@tcp:101:cat.0 Request processed in 616us (793us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788864892.990101:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:1.0:1788864892.996028:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864892.996187:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528784896 00000100:00100000:2.0:1788864892.996198:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528784896 00000100:00100000:2.0:1788864892.996249:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:2.0:1788864892.996259:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+34:10380:x1875760528784896:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:2.0:1788864892.996510:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+35:10380:x1875760528784896:12345-192.168.203.13@tcp:35:cat.0 Request processed in 252us (502us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788864892.996526:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:1.0:1788864892.997720:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864893.000349:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528785024 00000100:00100000:2.0:1788864893.000362:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528785024 00000100:00100000:2.0:1788864893.000457:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:2.0:1788864893.000469:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1e53450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+35:2359:x1875760528785024:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788864893.000485:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864893.000508:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9595be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb65 expref: 35 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864893.000528:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:2.0:1788864893.000533:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864893.000605:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1e53450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+34:2359:x1875760528785024:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 139us (2906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864893.000613:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00080000:3.0:1788864893.001669:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788864893.060446:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864893.061772:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528785280 00000100:00100000:0.0:1788864893.061783:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528785280 00000100:00100000:0.0:1788864893.061854:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:0.0:1788864893.061865:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+34:10385:x1875760528785280:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:0.0:1788864893.061888:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864893.061892:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788864893.061918:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959524 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb3b expref: 34 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.061947:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:0.0:1788864893.061953:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788864893.061967:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e9595cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fb6c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.062186:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e9595d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.062201:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e9595a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb5e expref: 34 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.062210:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e9595d3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.062240:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e9595a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb5e expref: 34 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.062252:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e9595a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb5e expref: 34 pid: 6705 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864893.062281:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875760546641024:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788864893.064719:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcacaa73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864893.082211:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864893.082308:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528785408 00000100:00100000:2.0:1788864893.082317:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528785408 00010000:00010000:2.0:1788864893.082360:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e9595a2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb5e expref: 35 pid: 6705 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864893.082415:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:2.0:1788864893.082426:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+35:2358:x1875760528785408:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788864893.082440:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864893.082447:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e9595a2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb5e expref: 35 pid: 6705 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864893.082460:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e9595a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb5e expref: 35 pid: 6705 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864893.082488:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:2.0:1788864893.082493:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e9595d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864893.082502:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e9595d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864893.082510:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e9595d3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864893.082536:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864893.082591:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+35:2358:x1875760528785408:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 166us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864893.082598:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00010000:00010000:0.0:1788864893.083070:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e9595a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb5e expref: 34 pid: 6705 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864893.083089:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875760546641024:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788864893.083107:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e9595d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.083116:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e9595d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.083123:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e9595d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864893.083140:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788864893.083287:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e9595cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb6c expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.083303:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e9595d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb6c expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.083309:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:0.0:1788864893.083312:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788864893.083314:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4be00, rc 0) 00000100:00100000:0.0:1788864893.083340:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+34:10385:x1875760528785280:12345-192.168.203.13@tcp:101:dd.0 Request processed in 21479us (22904us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788864893.083357:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:1.0:1788864893.089560:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864893.089645:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528785664 00000100:00100000:2.0:1788864893.089655:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528785664 00000100:00100000:2.0:1788864893.089739:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:2.0:1788864893.089750:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+34:10385:x1875760528785664:12345-192.168.203.13@tcp:36:dd.0 00010000:00010000:2.0:1788864893.090029:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9595e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864893.090048:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9595e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864893.090059:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9595e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788864893.090110:0:6705:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788864893.090133:0:6705:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a1033391 reply state 0000000021983929 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9595e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864893.090142:0:6705:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788864893.090222:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+37:10385:x1875760528785664:12345-192.168.203.13@tcp:36:dd.0 Request processed in 473us (670us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788864893.090229:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00000020:00080000:2.0:1788864893.090234:0:6705:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788864893.113817:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9595e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.113834:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9595e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.113841:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9595e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.113847:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864893.113878:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9595e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.113886:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9595e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.113902:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:1.0:1788864893.113905:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864893.113909:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9595e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.113916:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e9595e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864893.257774:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc07c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875760546641408:0@lo:400:kworker.0 00000100:00100000:3.0:1788864893.257842:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864893.257917:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788864893.257934:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc07c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875760546641280:0@lo:400:kworker.0 00000100:00100000:3.0:1788864893.257958:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864893.257998:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546641792:0@lo:400:kworker.0 00000100:00100000:3.0:1788864893.258035:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864893.258074:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546641792 00000100:00100000:3.0:1788864893.258082:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546641792 00000100:00100000:3.0:1788864893.258128:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788864893.258136:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3301:x1875760546641792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864893.258187:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3301:x1875760546641792:12345-0@lo:400:kworker.0 Request processed in 51us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864893.258194:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788864893.258233:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546641792:0@lo:400:kworker.0 00000100:00100000:2.0:1788864893.258434:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546641408 00000100:00100000:2.0:1788864893.258438:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546641408 00000100:00100000:2.0:1788864893.258481:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546641280 00000100:00100000:2.0:1788864893.258485:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546641280 00000100:00100000:2.0:1788864893.258518:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788864893.258527:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875760546641408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864893.258567:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875760546641408:12345-0@lo:400:kworker.0 Request processed in 42us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864893.258574:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788864893.258587:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788864893.258594:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875760546641280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864893.258633:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875760546641280:12345-0@lo:400:kworker.0 Request processed in 39us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864893.258639:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788864893.258673:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc07c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875760546641280:0@lo:400:kworker.0 00000100:00100000:2.0:1788864893.258683:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc07c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875760546641408:0@lo:400:kworker.0 00000100:00100000:1.0:1788864893.261665:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfe08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546641152:0@lo:400:kworker.0 00000100:00100000:1.0:1788864893.261778:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864893.261820:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875760546641664:0@lo:400:kworker.0 00000100:00100000:1.0:1788864893.261846:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864893.261883:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788864893.261890:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546641536:0@lo:400:kworker.0 00000100:00100000:1.0:1788864893.261917:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864893.261964:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546641536 00000100:00100000:1.0:1788864893.261980:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546641536 00000100:00100000:1.0:1788864893.262031:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788864893.262041:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546641536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864893.262092:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546641536:12345-0@lo:400:kworker.0 Request processed in 53us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864893.262099:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788864893.262135:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546641536:0@lo:400:kworker.0 00000100:00100000:0.0:1788864893.262340:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546641664 00000100:00100000:0.0:1788864893.262346:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546641664 00000100:00100000:0.0:1788864893.262388:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788864893.262396:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875760546641664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864893.262435:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875760546641664:12345-0@lo:400:kworker.0 Request processed in 41us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864893.262441:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788864893.263651:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546641152 00000100:00100000:2.0:1788864893.263663:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546641152 00000100:00100000:2.0:1788864893.263754:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788864893.263763:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3303:x1875760546641152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864893.263846:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3303:x1875760546641152:12345-0@lo:400:kworker.0 Request processed in 84us (2067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864893.263854:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00080000:3.0:1788864893.264608:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788864893.265367:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfe08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546641152:0@lo:400:kworker.0 00000100:00100000:1.0:1788864893.265385:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875760546641664:0@lo:400:kworker.0 00010000:00010000:0.0:1788864893.509015:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864893.534509:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864893.535202:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528785792 00000100:00100000:2.0:1788864893.535213:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528785792 00000100:00100000:2.0:1788864893.535277:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:2.0:1788864893.535287:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+36:10400:x1875760528785792:12345-192.168.203.13@tcp:101:stat.0 00010000:00010000:2.0:1788864893.535310:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864893.535330:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e9595e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fb73 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864893.535388:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e9595ef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864893.535401:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e9595ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864893.535424:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e9595ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864893.535453:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e9595f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864893.535461:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e9595f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864893.535467:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e9595f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864893.536042:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9595fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864893.536056:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e9595d3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb6c expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864893.536064:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9595fd lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864893.536097:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e9595d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb6c expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864893.536111:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e9595d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb6c expref: 37 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864893.536124:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6705:1875760546641920:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788864893.537187:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc833666c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864893.541670:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864893.542168:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528786048 00000100:00100000:3.0:1788864893.542182:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528786048 00000100:00100000:3.0:1788864893.542251:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1788864893.542263:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+38:5594:x1875760528786048:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788864893.542744:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+39:5594:x1875760528786048:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 480us (1084us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1788864893.542753:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:2.0:1788864893.543807:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6705:1875760546641920:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788864893.543839:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9595fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864893.547920:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864893.549449:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528786176 00000100:00100000:0.0:1788864893.549465:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528786176 00010000:00010000:0.0:1788864893.549544:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e9595d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb6c expref: 39 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864893.549615:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:0.0:1788864893.549631:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+39:2358:x1875760528786176:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788864893.549653:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864893.549662:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e9595d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb6c expref: 39 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.549677:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e9595d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb6c expref: 39 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.549737:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e9595d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb6c expref: 39 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.549757:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:0.0:1788864893.549781:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9595fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.549793:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9595fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.549801:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9595fd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.549847:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864893.549938:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+38:2358:x1875760528786176:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 312us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864893.549946:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00010000:00010000:1.0:1788864893.555301:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9595fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.555323:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9595fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864893.555391:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788864893.555396:0:6705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788864893.555461:0:6705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9595fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.555483:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9595fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.555496:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e9595ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.555515:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e9595ef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.555525:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e9595ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.555531:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864893.555536:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e9595ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.555565:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e9595ef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.555587:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:1.0:1788864893.555590:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864893.555597:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e9595ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.555603:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e9595ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.555620:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e9595f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.555627:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e9595f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.555633:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e9595f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.555639:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864893.555641:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e9595f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.555648:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e9595f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.555655:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fdc9124e500) 00010000:00010000:1.0:1788864893.555658:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864893.555660:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e9595f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.555679:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e9595f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.556011:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e9595e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb73 expref: 38 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.556095:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9595fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb73 expref: 37 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.556104:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:1.0:1788864893.556107:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788864893.556111:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385c00, rc 0) 00000100:00100000:1.0:1788864893.556210:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+37:10400:x1875760528785792:12345-192.168.203.13@tcp:101:stat.0 Request processed in 20922us (21709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864893.556220:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:1.0:1788864893.675170:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864893.675281:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528786432 00000100:00100000:2.0:1788864893.675296:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528786432 00000100:00100000:2.0:1788864893.675371:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:2.0:1788864893.675382:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+37:10406:x1875760528786432:12345-192.168.203.13@tcp:36:truncate.0 00010000:00010000:2.0:1788864893.675448:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864893.675474:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9595fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb73 expref: 37 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864893.675495:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:2.0:1788864893.675500:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788864893.675759:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e959604 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864893.675774:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e959604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864893.675784:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e959604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788864893.675835:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1788864893.675860:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eea56ac3 reply state 0000000074d8f5b3 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e959604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864893.675869:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788864893.675990:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+39:10406:x1875760528786432:12345-192.168.203.13@tcp:36:truncate.0 Request processed in 608us (834us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788864893.675998:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00000020:00080000:2.0:1788864893.676010:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788864893.687160:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e959604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.687177:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e959604 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.687185:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e959604 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.687192:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864893.687196:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e959604 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.687220:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e959604 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.687236:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:1.0:1788864893.687239:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864893.687244:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e959604 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864893.687251:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e959604 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788864893.765196:0:8097:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 316896489304ns, next at 317896487190ns, rc = 0 00000100:00100000:0.0:1788864893.765278:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788864893.765299:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546642048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788864893.765369:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864893.765740:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546642048 00000100:00100000:1.0:1788864893.765748:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546642048 00000100:00100000:1.0:1788864893.765798:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788864893.765807:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbba7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875760546642048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788864893.765839:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788864893.765883:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbba7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875760546642048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864893.765890:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788864893.768696:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546642048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788864893.853529:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864893.853759:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528786560 00000100:00100000:0.0:1788864893.853772:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528786560 00000100:00100000:0.0:1788864893.853854:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:0.0:1788864893.853875:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+38:10420:x1875760528786560:12345-192.168.203.13@tcp:101:stat.0 00010000:00010000:0.0:1788864893.853908:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864893.853936:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95960b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fb7a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854037:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959612 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854055:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959612 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854086:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959612 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854105:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959619 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854112:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854119:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854226:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e959620 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854235:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e959620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854243:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e959620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864893.854287:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788864893.854292:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788864893.854320:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e959620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854333:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e959620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854341:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959612 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854358:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959612 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854364:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959612 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854370:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4b200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864893.854375:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959612 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854383:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959612 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854397:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:0.0:1788864893.854400:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864893.854406:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959612 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854413:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959612 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854428:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854434:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959619 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854439:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959619 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854444:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4ba00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864893.854457:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959619 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854464:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959619 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854472:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fdca4f57a00) 00010000:00010000:0.0:1788864893.854475:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864893.854477:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959619 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854484:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959619 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854520:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95960b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb7a expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854535:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e959620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb7a expref: 39 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864893.854544:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:0.0:1788864893.854546:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788864893.854549:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4b800, rc 0) 00000100:00100000:0.0:1788864893.854631:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+39:10420:x1875760528786560:12345-192.168.203.13@tcp:101:stat.0 Request processed in 766us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864893.854639:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:3.0:1788864893.980811:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864893.980948:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528786816 00000100:00100000:2.0:1788864893.980957:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528786816 00000100:00100000:2.0:1788864893.981021:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:2.0:1788864893.981032:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+39:10430:x1875760528786816:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788864893.981053:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864893.981073:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959627 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fb81 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864893.981160:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788864893.981282:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959627 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb81 expref: 41 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864893.981298:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdca4f57300) 00010000:00010000:2.0:1788864893.981302:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788864893.981307:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959627 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb81 expref: 41 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864893.981321:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385000, rc 0) 00000100:00100000:2.0:1788864893.981381:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+40:10430:x1875760528786816:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 351us (578us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1788864893.981388:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:2.0:1788864893.988883:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864893.988990:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528787072 00000100:00100000:3.0:1788864893.989021:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528787072 00000100:00100000:3.0:1788864893.989120:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:3.0:1788864893.989133:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+40:10430:x1875760528787072:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1788864893.989457:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+41:10430:x1875760528787072:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 326us (581us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1788864893.989466:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:1.0:1788864894.087931:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864894.088172:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528787328 00000100:00100000:0.0:1788864894.088186:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528787328 00000100:00100000:0.0:1788864894.088267:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:0.0:1788864894.088279:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+41:10436:x1875760528787328:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788864894.088326:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864894.088349:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e959635 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fb88 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.088487:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95963c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.088511:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e959620 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb7a expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.088521:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95963c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.088560:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e959620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb7a expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.088575:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e959620 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb7a expref: 42 pid: 5837 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864894.088590:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbba7c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875760546642176:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788864894.088692:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcacaa7240 going to sleep for 11 seconds 00000100:00100000:0.0:1788864894.094296:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbba7c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875760546642176:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788864894.094335:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95963c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864894.097436:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864894.097674:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528787456 00000100:00100000:2.0:1788864894.097687:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528787456 00010000:00010000:2.0:1788864894.097774:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e959620 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb7a expref: 43 pid: 5837 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864894.097832:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:2.0:1788864894.097843:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+43:2359:x1875760528787456:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788864894.097859:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864894.097866:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e959620 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb7a expref: 43 pid: 5837 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.097881:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e959620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb7a expref: 43 pid: 5837 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.097903:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e959620 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb7a expref: 43 pid: 5837 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.097921:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:2.0:1788864894.097927:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95963c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.097936:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95963c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.097944:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95963c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.097975:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788864894.098033:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95963c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.098045:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95963c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864894.098058:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+42:2359:x1875760528787456:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 214us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864894.098067:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00000004:00200000:0.0:1788864894.098102:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788864894.098309:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e959635 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb88 expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.098332:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95963c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb88 expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.098341:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:0.0:1788864894.098345:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788864894.098348:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4ba00, rc 0) 00000100:00100000:0.0:1788864894.098407:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+42:10436:x1875760528787328:12345-192.168.203.13@tcp:101:bash.0 Request processed in 10130us (10490us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1788864894.098417:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:1.0:1788864894.101289:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864894.101411:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528787712 00000100:00100000:2.0:1788864894.101438:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528787712 00000100:00100000:2.0:1788864894.101524:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:2.0:1788864894.101536:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+42:10436:x1875760528787712:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:2.0:1788864894.101932:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95964a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.101953:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95964a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.101966:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95964a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788864894.102151:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1788864894.102179:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000df9cf6d reply state 00000000e798d0bf transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95964a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864894.102191:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788864894.102287:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+45:10436:x1875760528787712:12345-192.168.203.13@tcp:36:bash.0 Request processed in 752us (1010us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788864894.102295:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00000020:00080000:2.0:1788864894.102300:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788864894.106045:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95964a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864894.106070:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95964a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864894.106102:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95964a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864894.106109:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864894.106115:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95964a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864894.106124:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95964a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864894.106144:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:1.0:1788864894.106148:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864894.106153:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95964a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864894.106160:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95964a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864894.112740:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864894.113534:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528787840 00000100:00100000:2.0:1788864894.113549:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528787840 00000100:00100000:2.0:1788864894.113618:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:2.0:1788864894.113630:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+44:10436:x1875760528787840:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1788864894.113660:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864894.113695:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959651 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fb8f expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.113872:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e959658 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.113898:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95963c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb88 expref: 45 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.113907:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e959658 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.113949:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95963c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb88 expref: 45 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.113965:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95963c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb88 expref: 45 pid: 5837 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864894.113981:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6705:1875760546642304:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788864894.114266:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc860b50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864894.118250:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6705:1875760546642304:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788864894.118292:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e959658 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864894.121670:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864894.121865:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528787968 00000100:00100000:2.0:1788864894.121878:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528787968 00010000:00010000:2.0:1788864894.121929:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95963c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb88 expref: 46 pid: 5837 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864894.121976:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:2.0:1788864894.121988:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+46:2358:x1875760528787968:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788864894.122390:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864894.122418:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95963c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb88 expref: 46 pid: 5837 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.122435:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95963c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb88 expref: 46 pid: 5837 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.122463:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95963c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb88 expref: 46 pid: 5837 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.122485:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:2.0:1788864894.122490:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e959658 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.122501:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e959658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.122509:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e959658 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.122551:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864894.122666:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+45:2358:x1875760528787968:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 679us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864894.122675:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00010000:00010000:3.0:1788864894.123197:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e959658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864894.123208:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e959658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788864894.123268:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788864894.123273:0:6705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788864894.123305:0:6705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e959658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864894.123346:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959651 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb8f expref: 45 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864894.123375:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e959658 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb8f expref: 44 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864894.123384:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:3.0:1788864894.123386:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788864894.123390:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384800, rc 0) 00000100:00100000:3.0:1788864894.123430:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+44:10436:x1875760528787840:12345-192.168.203.13@tcp:101:bash.0 Request processed in 9802us (10747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864894.123438:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:3.0:1788864894.129197:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864894.130430:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528788224 00000100:00100000:2.0:1788864894.130447:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528788224 00000100:00100000:2.0:1788864894.131053:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:2.0:1788864894.131070:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb103a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+44:10436:x1875760528788224:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:2.0:1788864894.131924:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb103a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+45:10436:x1875760528788224:12345-192.168.203.13@tcp:35:bash.0 Request processed in 855us (2737us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1788864894.131955:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:0.0:1788864894.282936:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864894.283171:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528788480 00000100:00100000:2.0:1788864894.283185:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528788480 00000100:00100000:2.0:1788864894.283256:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:2.0:1788864894.283268:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbba7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+45:10446:x1875760528788480:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788864894.283302:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864894.283330:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95965f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fb96 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864894.283461:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788864894.283625:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95965f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb96 expref: 47 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.283643:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdca4f57300) 00010000:00010000:2.0:1788864894.283646:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788864894.283652:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95965f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb96 expref: 47 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.283669:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384a00, rc 0) 00000100:00100000:2.0:1788864894.283808:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbba7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+46:10446:x1875760528788480:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 542us (887us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1788864894.283817:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:1.0:1788864894.294235:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864894.294547:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528788608 00000100:00100000:0.0:1788864894.294560:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528788608 00000100:00100000:0.0:1788864894.294635:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:0.0:1788864894.294645:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+46:10446:x1875760528788608:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:0.0:1788864894.294798:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e95966d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.294818:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e95966d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.294841:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e95966d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295075:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e959674 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295100:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e959674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295108:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e959674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295217:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e95967b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295226:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e95967b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295233:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e95967b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788864894.295280:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e95967b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295292:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e95966d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295299:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e95966d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295307:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e95966d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295313:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4b200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864894.295318:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e95966d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295325:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e95966d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295344:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:0.0:1788864894.295347:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864894.295353:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e95966d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295425:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e95966d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295442:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e959674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295449:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e959674 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295455:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e959674 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295459:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864894.295462:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e959674 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295468:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e959674 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295475:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fdca4f57a00) 00010000:00010000:0.0:1788864894.295477:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864894.295480:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e959674 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295485:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e959674 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295561:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e95967b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295568:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e95967b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295574:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e95967b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295579:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4b000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864894.295582:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e95967b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295588:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e95967b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295595:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:0.0:1788864894.295597:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864894.295600:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e95967b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.295606:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e95967b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864894.295700:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+46:10446:x1875760528788608:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 1054us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864894.295963:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:1.0:1788864894.301613:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864894.301906:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528788864 00000100:00100000:0.0:1788864894.301919:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528788864 00000100:00100000:0.0:1788864894.301986:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1788864894.302033:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+46:10446:x1875760528788864:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1788864894.302319:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+47:10446:x1875760528788864:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 287us (718us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788864894.302326:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:1.0:1788864894.399457:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864894.400254:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528789120 00000100:00100000:2.0:1788864894.400269:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528789120 00000100:00100000:2.0:1788864894.400355:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:2.0:1788864894.400367:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+47:10449:x1875760528789120:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788864894.400419:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864894.400447:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959682 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fb9d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.400555:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959689 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.400572:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959689 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.400586:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959689 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.400603:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959690 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.400610:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.400617:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.400809:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959697 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.400819:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959697 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.400835:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959697 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864894.400847:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788864894.401265:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959689 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.401275:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959689 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.401282:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959689 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.401289:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864894.401294:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959689 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.401303:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959689 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.401318:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:2.0:1788864894.401321:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864894.401327:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959689 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.401334:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959689 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.401350:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.401356:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959690 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.401362:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959690 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.401368:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864894.401378:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959690 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.401385:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959690 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.401393:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fdc9124e400) 00010000:00010000:2.0:1788864894.401395:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864894.401398:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959690 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.401405:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959690 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.401459:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959682 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb9d expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.401474:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959697 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb9d expref: 49 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.401482:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:2.0:1788864894.401484:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788864894.401487:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385400, rc 0) 00000100:00100000:2.0:1788864894.402155:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+49:10449:x1875760528789120:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1786us (2707us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788864894.402167:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:1.0:1788864894.408414:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864894.408543:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864894.408755:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528789376 00000100:00100000:0.0:1788864894.408768:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528789376 00000100:00100000:0.0:1788864894.408841:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:0.0:1788864894.408854:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca0d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+49:10449:x1875760528789376:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:0.0:1788864894.408974:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9596a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.409003:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9596a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.409026:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9596a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.409061:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9596a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.409070:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9596a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.409077:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9596a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.409084:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4b000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864894.409090:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9596a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.409112:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9596a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.409127:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:0.0:1788864894.409130:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788864894.409136:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9596a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.409142:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9596a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864894.409237:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca0d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+49:10449:x1875760528789376:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 384us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864894.409246:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:2.0:1788864894.409543:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528789248 00000100:00100000:2.0:1788864894.409549:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528789248 00000100:00100000:2.0:1788864894.409588:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:2.0:1788864894.409595:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+49:2359:x1875760528789248:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788864894.409614:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864894.409632:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959697 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb9d expref: 49 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864894.409645:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:2.0:1788864894.409648:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864894.409674:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+48:2359:x1875760528789248:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 80us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864894.409680:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:1.0:1788864894.428485:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864894.428610:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528789632 00000100:00100000:0.0:1788864894.428623:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528789632 00000100:00100000:0.0:1788864894.428698:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:0.0:1788864894.428746:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca0d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+48:10449:x1875760528789632:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1788864894.429083:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca0d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+49:10449:x1875760528789632:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 339us (611us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788864894.429091:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00010000:00010000:2.0:1788864894.535443:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864894.718515:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864894.718637:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528789888 00000100:00100000:0.0:1788864894.718647:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528789888 00000100:00100000:0.0:1788864894.718733:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:0.0:1788864894.718743:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca0d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+49:10467:x1875760528789888:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:0.0:1788864894.718765:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864894.718784:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9596ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fba4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.718890:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9596b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.718906:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9596b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.718917:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9596b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864894.718929:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788864894.719073:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9596ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fba4 expref: 52 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.719091:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9596b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fba4 expref: 51 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.719100:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:0.0:1788864894.719103:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788864894.719107:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4b200, rc 0) 00000100:00100000:0.0:1788864894.719164:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca0d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+51:10467:x1875760528789888:12345-192.168.203.13@tcp:101:cat.0 Request processed in 422us (663us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788864894.719171:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:1.0:1788864894.790418:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864894.790523:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528790016 00000100:00100000:0.0:1788864894.790533:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528790016 00000100:00100000:0.0:1788864894.790588:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:0.0:1788864894.790598:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca0d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+51:10468:x1875760528790016:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788864894.790624:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864894.790658:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9596c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fbab expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.790743:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e9596c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.790756:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e9596c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.790767:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e9596c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864894.790799:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788864894.790803:0:6705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788864894.790819:0:6705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e9596c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.790844:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9596c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbab expref: 53 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.790861:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e9596c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbab expref: 52 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.790869:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:0.0:1788864894.790872:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788864894.790875:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4ac00, rc 0) 00000100:00100000:0.0:1788864894.790935:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca0d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+52:10468:x1875760528790016:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 339us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864894.790943:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:1.0:1788864894.794252:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864894.794390:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528790400 00000100:00100000:2.0:1788864894.794401:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528790400 00000100:00100000:2.0:1788864894.794454:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:2.0:1788864894.794464:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca0d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+52:10468:x1875760528790400:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788864894.794809:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca0d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+53:10468:x1875760528790400:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 345us (565us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788864894.794816:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:2.0:1788864894.799666:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864894.799784:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528790528 00000100:00100000:1.0:1788864894.799794:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528790528 00000100:00100000:1.0:1788864894.799864:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:1.0:1788864894.799875:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+53:10468:x1875760528790528:12345-192.168.203.13@tcp:103:lfs.0 00010000:00010000:1.0:1788864894.799890:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788864894.799914:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e959658 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb8f expref: 53 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864894.799935:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9596b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fba4 expref: 52 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864894.799947:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959563 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb50 expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864894.799957:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57700) 00010000:00010000:1.0:1788864894.799968:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864894.800040:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+50:10468:x1875760528790528:12345-192.168.203.13@tcp:103:lfs.0 Request processed in 167us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864894.800047:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:1.0:1788864894.805910:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864894.806017:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528790656 00000100:00100000:0.0:1788864894.806039:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528790656 00000100:00100000:0.0:1788864894.806097:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:0.0:1788864894.806107:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca0d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+50:10468:x1875760528790656:12345-192.168.203.13@tcp:58:lfs.0 00010000:00010000:0.0:1788864894.806220:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9596cf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.806237:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9596cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.806248:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9596cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788864894.806556:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788864894.806775:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788864894.806839:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788864894.806937:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca0d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+50:10468:x1875760528790656:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 830us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864894.806946:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:3.0:1788864894.852382:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864894.852834:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528790784 00000100:00100000:0.0:1788864894.852845:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528790784 00000100:00100000:0.0:1788864894.852956:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:0.0:1788864894.852967:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+50:10470:x1875760528790784:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788864894.852989:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864894.853017:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e9596d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fbb2 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853088:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9596dd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853103:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9596dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853128:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9596dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853144:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e9596e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853151:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e9596e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853158:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e9596e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853238:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9596eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853250:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9596eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853259:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9596eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864894.853294:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788864894.853298:0:6705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788864894.853316:0:6705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9596eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853326:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9596eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853334:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9596dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853349:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9596dd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853355:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9596dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853361:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864894.853365:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9596dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853372:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9596dd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853383:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:0.0:1788864894.853385:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864894.853390:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9596dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853396:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9596dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853409:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e9596e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853415:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e9596e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853420:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e9596e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853425:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4b400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864894.853436:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e9596e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853442:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e9596e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853450:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fdca4f57600) 00010000:00010000:0.0:1788864894.853453:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864894.853456:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e9596e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853463:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e9596e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853494:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e9596d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbb2 expref: 52 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853508:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9596eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbb2 expref: 51 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864894.853515:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57a00) 00010000:00010000:0.0:1788864894.853517:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788864894.853520:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4b200, rc 0) 00000100:00100000:0.0:1788864894.854024:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+51:10470:x1875760528790784:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1057us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864894.854032:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:3.0:1788864894.874635:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864894.874797:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864894.875042:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528791168 00000100:00100000:0.0:1788864894.875052:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528791168 00000100:00080000:0.0:1788864894.875093:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788864894.875137:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00100000:0.0:1788864894.875162:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528791168:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788864894.875243:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528790912 00000100:00100000:2.0:1788864894.875248:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528790912 00000100:00100000:2.0:1788864894.875279:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 284 00000100:00100000:2.0:1788864894.875286:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:2358:x1875760528790912:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864894.875327:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864894.879345:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528791168:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 4174us (4536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864894.879358:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00100000:0.0:1788864894.879493:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528791040 00000100:00100000:0.0:1788864894.879513:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528791040 00000100:00100000:0.0:1788864894.879567:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:0.0:1788864894.879576:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2358:x1875760528791040:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788864894.879620:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2358:x1875760528791040:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 46us (4293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864894.879626:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00080000:0.0:1788864894.879642:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788864894.880024:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:2358:x1875760528790912:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 4540us (5199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864894.880034:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 284 00010000:00010000:1.0:1788864895.558928:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788864895.735097:0:11986:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788864895.735106:0:11986:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788864895.735163:0:11986:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788864895.735170:0:11986:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788864895.758104:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788864895.758114:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788864895.758169:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788864895.758176:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788864895.758295:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca0d5c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1875760546642432:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788864895.758389:0:11671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca8d280c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864895.790138:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca0d5c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1875760546642432:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788864895.824229:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864895.824317:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528791296 00000100:00100000:0.0:1788864895.824326:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528791296 00000100:00100000:0.0:1788864895.824388:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:0.0:1788864895.824398:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+51:10482:x1875760528791296:12345-192.168.203.13@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788864895.824476:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+51:10482:x1875760528791296:12345-192.168.203.13@tcp:900:lhsmtool_posix.0 Request processed in 80us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864895.824483:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00080000:1.0:1788864895.825075:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788864895.847788:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864895.847879:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528791424 00000100:00100000:0.0:1788864895.847902:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528791424 00000100:00100000:0.0:1788864895.847962:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:0.0:1788864895.847972:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+51:10482:x1875760528791424:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788864895.848013:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788864895.848117:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+51:10482:x1875760528791424:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 146us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864895.848137:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:0.0:1788864895.864190:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864895.864265:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528791552 00000100:00100000:1.0:1788864895.864276:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528791552 00000100:00100000:1.0:1788864895.864333:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:1.0:1788864895.864344:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+51:10482:x1875760528791552:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788864895.864420:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9596f2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864438:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9596f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864451:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9596f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864552:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9596f9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864561:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9596f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864568:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9596f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864596:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e959700 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864604:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e959700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864610:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e959700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864895.864646:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788864895.864656:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788864895.864670:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e959700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864682:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9596f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864688:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9596f2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864696:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9596f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864731:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864895.864736:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9596f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864744:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9596f2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864756:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fdca4f57c00) 00010000:00010000:1.0:1788864895.864760:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864895.864764:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9596f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864771:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9596f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864784:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9596f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864790:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9596f9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864808:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9596f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864813:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864895.864816:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9596f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864822:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9596f9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864831:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9fdc8328ef00) 00010000:00010000:1.0:1788864895.864833:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864895.864836:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9596f9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864841:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9596f9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864857:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e959700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864863:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e959700 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864869:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e959700 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.864873:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864895.864876:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e959700 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.865359:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e959700 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.865369:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57a00) 00010000:00010000:1.0:1788864895.865371:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864895.865375:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e959700 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.865381:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e959700 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864895.865504:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+51:10482:x1875760528791552:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 1160us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864895.865514:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:0.0:1788864895.885090:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864895.885799:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528791808 00000100:00100000:2.0:1788864895.885811:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528791808 00000100:00100000:2.0:1788864895.885879:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:2.0:1788864895.885907:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafc9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+51:10482:x1875760528791808:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788864895.885927:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864895.885946:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959707 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fbb9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.886047:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95970e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.886068:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95970e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.886083:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95970e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864895.886095:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788864895.886185:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95970e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.886193:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95970e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.886200:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95970e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.886205:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864895.886220:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95970e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.886229:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95970e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.886240:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57a00) 00010000:00010000:2.0:1788864895.886243:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788864895.886247:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95970e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.886254:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95970e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.886294:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959707 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbb9 expref: 53 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.886304:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fdca4f57c00) 00010000:00010000:2.0:1788864895.886307:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788864895.886311:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959707 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbb9 expref: 53 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.886321:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384600, rc 0) 00000100:00100000:2.0:1788864895.886384:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafc9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+52:10482:x1875760528791808:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 481us (1302us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1788864895.886390:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:3.0:1788864895.892273:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864895.892356:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528791936 00000100:00100000:0.0:1788864895.892365:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528791936 00000100:00100000:0.0:1788864895.892422:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:0.0:1788864895.892433:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+52:10482:x1875760528791936:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788864895.892476:0:5835:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788864895.892603:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+52:10482:x1875760528791936:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 171us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864895.892611:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:3.0:1788864895.905330:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864895.905423:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528792192 00000100:00100000:0.0:1788864895.905434:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528792192 00000100:00100000:0.0:1788864895.905505:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:0.0:1788864895.905516:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+52:10482:x1875760528792192:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788864895.905537:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864895.905540:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788864895.905569:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e9596c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbab expref: 52 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864895.905587:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:0.0:1788864895.905592:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788864895.905604:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e95971c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fbc0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788864895.906229:0:6705:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788864895.906437:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959723 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864895.906451:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959723 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864895.906462:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959723 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864895.908192:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e95971c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbc0 expref: 54 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864895.908219:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959723 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbc0 expref: 53 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864895.908227:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fdca4f57600) 00010000:00010000:0.0:1788864895.908230:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788864895.908234:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4b600, rc 0) 00000100:00100000:0.0:1788864895.908340:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+53:10482:x1875760528792192:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 2825us (3021us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788864895.908348:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:1.0:1788864895.923803:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864895.924003:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528792448 00000100:00100000:2.0:1788864895.924012:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528792448 00000100:00100000:2.0:1788864895.924073:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:2.0:1788864895.924084:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca0d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+53:10482:x1875760528792448:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788864895.924152:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864895.924179:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959723 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbc0 expref: 53 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.924198:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fdca4f57600) 00010000:00010000:2.0:1788864895.924210:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788864895.924233:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959731 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.924246:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959731 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.924256:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959731 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.924270:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e959738 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x5647e745 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.924278:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e959738 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5647e745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.924285:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e959738 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5647e745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.924344:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959731 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.924352:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959731 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.924358:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959731 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.924371:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864895.924375:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959731 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.924383:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959731 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.924392:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:2.0:1788864895.924395:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864895.924399:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959731 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.924405:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959731 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.924416:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e959738 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5647e745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.924421:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e959738 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5647e745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.924428:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e959738 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5647e745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.924433:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864895.924436:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e959738 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5647e745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.924442:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e959738 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5647e745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.924460:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x5647e745 (ffff9fdc9124e400) 00010000:00010000:2.0:1788864895.924462:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864895.924465:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e959738 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5647e745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.924471:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e959738 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5647e745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864895.924607:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca0d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+52:10482:x1875760528792448:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 525us (814us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788864895.924615:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:0.0:1788864895.935218:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864895.935288:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528792576 00000100:00100000:2.0:1788864895.935297:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528792576 00000100:00100000:2.0:1788864895.935352:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:2.0:1788864895.935363:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafc9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+52:10482:x1875760528792576:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788864895.935383:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864895.935405:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95973f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fbc7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.935439:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959746 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.935467:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864895.935480:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864895.936014:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95973f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbc7 expref: 54 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864895.936031:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959746 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbc7 expref: 53 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864895.936039:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fdc9124e400) 00010000:00010000:0.0:1788864895.936050:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788864895.936054:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384600, rc 0) 00000100:00100000:0.0:1788864895.936116:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafc9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+53:10482:x1875760528792576:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 754us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864895.936124:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:3.0:1788864895.952254:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864895.952352:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528792832 00000100:00100000:0.0:1788864895.952363:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528792832 00000100:00100000:0.0:1788864895.952426:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:0.0:1788864895.952437:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+53:10482:x1875760528792832:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788864895.952524:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e95974d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864895.952541:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e95974d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864895.952553:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e95974d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788864895.952852:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1788864895.952862:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 319084157605ns, next at 320084155457ns, rc = 0 00000004:00010000:0.0:1788864895.953026:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b382ccc9 reply state 00000000a0223acd transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e95974d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864895.953036:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788864895.953127:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+55:10482:x1875760528792832:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 692us (882us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1788864895.953134:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 75 00010000:00010000:1.0:1788864895.955322:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e95974d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.955338:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e95974d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.955345:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e95974d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.955351:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864895.955357:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e95974d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.955365:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e95974d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.955402:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fdc9124e400) 00010000:00010000:1.0:1788864895.955405:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788864895.955410:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e95974d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864895.955416:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e95974d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864895.963173:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864895.963433:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528792960 00000100:00100000:0.0:1788864895.963443:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528792960 00000100:00100000:0.0:1788864895.963528:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:0.0:1788864895.963538:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+54:10482:x1875760528792960:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788864895.963563:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864895.963582:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e959754 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fbce expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864895.963635:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e959754 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbce expref: 55 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864895.963648:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e959754 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbce expref: 55 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864895.963664:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fdc9124e400) 00010000:00010000:0.0:1788864895.963667:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788864895.963671:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4ac00, rc 0) 00000100:00100000:0.0:1788864895.963740:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+55:10482:x1875760528792960:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 204us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864895.963747:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:3.0:1788864895.971860:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864895.972001:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528793088 00000100:00100000:2.0:1788864895.972011:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528793088 00000100:00100000:2.0:1788864895.972064:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:2.0:1788864895.972073:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1875760528793088:12345-192.168.203.13@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788864895.972105:0:6684:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp t0 exp 0000000000000000 cur 319 last 0 00000020:00000080:2.0:1788864895.972152:0:6684:0:(genops.c:1384:class_connect()) connect: client 1cf2dd0f-7f2d-465e-9303-244222bc89bf, cookie 0xf8c13e2d0e95975b 00002000:00100000:2.0:1788864895.972163:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1cf2dd0f-7f2d-465e-9303-244222bc89bf/ffff9fdcbc867000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788864895.972186:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788864895.972402:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788864895.972443:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9fdcbc866000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788864895.972513:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2355:x1875760528793088:12345-192.168.203.13@tcp:8:lhsmtool_posix.0 Request processed in 440us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864895.972521:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:3.0:1788864895.975631:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864895.975742:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528793216 00000100:00100000:1.0:1788864895.975753:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528793216 00000100:00100000:1.0:1788864895.975812:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:1.0:1788864895.975824:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:0:x1875760528793216:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788864895.976413:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788864896.037210:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:1.0:1788864896.037233:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1cf2dd0f-7f2d-465e-9303-244222bc89bf 00000100:00100000:1.0:1788864896.037340:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:0:x1875760528793216:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 61514us (61712us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788864896.037351:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:2.0:1788864896.046801:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864896.046837:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528793472 00000100:00100000:2.0:1788864896.046847:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528793472 00000100:00100000:2.0:1788864896.046970:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:2.0:1788864896.046982:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86ebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+55:10482:x1875760528793472:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788864896.047215:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86ebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+56:10482:x1875760528793472:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 235us (422us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788864896.047223:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:3.0:1788864896.056968:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864896.057113:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528793728 00000100:00100000:2.0:1788864896.057123:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528793728 00000100:00100000:2.0:1788864896.057175:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:2.0:1788864896.057185:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+56:10482:x1875760528793728:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788864896.057308:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+56:10482:x1875760528793728:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 123us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864896.057316:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:3.0:1788864896.061121:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864896.061267:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528793856 00000100:00100000:0.0:1788864896.061278:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528793856 00000100:00100000:0.0:1788864896.061368:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:0.0:1788864896.061379:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+56:10482:x1875760528793856:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788864896.061396:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864896.061414:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959762 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fbd5 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.061488:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e959769 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.061514:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e959769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.061526:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e959769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864896.061564:0:6705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788864896.061582:0:6705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e959769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.061607:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959762 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbd5 expref: 58 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.061623:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e959769 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbd5 expref: 57 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.061631:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fdc9124e400) 00010000:00010000:0.0:1788864896.061633:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788864896.061637:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4b800, rc 0) 00000100:00100000:0.0:1788864896.061696:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+57:10482:x1875760528793856:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 319us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864896.061735:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:3.0:1788864896.069929:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864896.070071:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528793984 00000100:00100000:2.0:1788864896.070082:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528793984 00000100:00100000:2.0:1788864896.070135:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:2.0:1788864896.070149:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2357:x1875760528793984:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788864896.070168:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864896.070188:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097c8b3e8/0xf8c13e2d0e959770 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fbdc expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788864896.070216:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fe97f, blocks: 0x1 00010000:00010000:2.0:1788864896.070236:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=319s v=(0 0) 00010000:00010000:2.0:1788864896.070241:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864896.070250:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097c8b3e8/0xf8c13e2d0e959770 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbdc expref: 6 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.070269:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000097c8b3e8/0xf8c13e2d0e959770 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbdc expref: 6 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.070282:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384200, rc 0) 00000100:00100000:2.0:1788864896.070341:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2357:x1875760528793984:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 198us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864896.070349:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:3.0:1788864896.074956:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864896.075037:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528794240 00000100:00100000:2.0:1788864896.075059:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528794240 00000100:00100000:2.0:1788864896.075124:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:2.0:1788864896.075135:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+57:10482:x1875760528794240:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788864896.075237:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+57:10482:x1875760528794240:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 103us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864896.075244:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:0.0:1788864896.085430:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864896.085523:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528794368 00000100:00100000:3.0:1788864896.085534:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528794368 00000100:00100000:3.0:1788864896.085593:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:3.0:1788864896.085603:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:10482:x1875760528794368:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788864896.085620:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864896.085642:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959777 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fbe3 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.085672:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000097c8b3e8/0xf8c13e2d0e959770 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbdc expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.085681:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788864896.085685:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788864896.085690:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959777 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbe3 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.086001:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000097c8b3e8/0xf8c13e2d0e959770 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbdc expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.086016:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000097c8b3e8/0xf8c13e2d0e959770 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbdc expref: 7 pid: 6684 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864896.086031:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1875760546642560:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788864896.087024:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca07dc6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788864896.104007:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864896.104173:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1875760546642560:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788864896.104210:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959777 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbe3 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.104232:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213ec00, rc 0) 00000100:00100000:2.0:1788864896.104289:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:10482:x1875760528794368:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 18686us (18868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864896.104298:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:0.0:1788864896.104639:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528794496 00000100:00100000:0.0:1788864896.104647:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528794496 00010000:00010000:0.0:1788864896.104679:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000097c8b3e8/0xf8c13e2d0e959770 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbdc expref: 7 pid: 6684 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864896.104757:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:0.0:1788864896.104766:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1e50050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2359:x1875760528794496:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788864896.104780:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864896.104801:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000097c8b3e8/0xf8c13e2d0e959770 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbdc expref: 7 pid: 6684 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.104814:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000097c8b3e8/0xf8c13e2d0e959770 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbdc expref: 7 pid: 6684 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.104838:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097c8b3e8/0xf8c13e2d0e959770 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbdc expref: 7 pid: 6684 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.104853:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788864896.104857:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788864896.104864:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959777 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbe3 expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.104875:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959777 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbe3 expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.105042:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959777 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbe3 expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864896.105057:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcafc98e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5820:1875760546642688:192.168.203.13@tcp:105: 00000100:00100000:0.0:1788864896.105116:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcacaa7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788864896.112239:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcafc98e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5820:1875760546642688:192.168.203.13@tcp:105: 00010000:00010000:1.0:1788864896.112265:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864896.112321:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1e50050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2359:x1875760528794496:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 7555us (8334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864896.112333:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:0.0:1788864896.112609:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864896.112781:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528794624 00000100:00100000:1.0:1788864896.112789:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528794624 00002000:00100000:1.0:1788864896.112829:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9fdcafc9b800 x1875760528794624/t0(0) o4->1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp:372/0 lens 504/0 e 0 to 0 dl 1788864907 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788864896.112867:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fdcafc9b800 with x1875760528794624 ext(0->8) 00002000:00010000:1.0:1788864896.112871:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fdcafc9b800 00000100:00100000:1.0:1788864896.112906:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:1.0:1788864896.112915:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafc9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2358:x1875760528794624:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788864896.113501:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafc9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2358:x1875760528794624:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 Request processed in 585us (890us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788864896.113524:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00002000:00100000:1.0:1788864896.113532:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9fdcafc9b800 x1875760528794624/t4294967302(0) o4->1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp:372/0 lens 504/448 e 0 to 0 dl 1788864907 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788864896.113540:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fdcafc9b800 with x1875760528794624 ext(0->8) 00002000:00010000:1.0:1788864896.113544:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fdcafc9b800 00000100:00100000:0.0:1788864896.123545:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864896.123626:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528794752 00000100:00100000:1.0:1788864896.123637:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528794752 00000100:00100000:1.0:1788864896.123694:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:1.0:1788864896.123723:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+57:10482:x1875760528794752:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788864896.214839:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:1.0:1788864896.214852:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1788864896.214958:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1788864896.214977:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:1.0:1788864896.215082:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788864896.215230:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcafc98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546642816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788864896.215303:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864896.215367:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546642816 00000100:00100000:0.0:1788864896.215375:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546642816 00000100:00100000:0.0:1788864896.215426:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788864896.215435:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafc99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546642816:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788864896.215587:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788864896.215590:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788864895 00002000:00010000:0.0:1788864896.215593:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788864896.215595:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788864895 -> 1788864895 00002000:00010000:0.0:1788864896.215596:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788864896.215635:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafc99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1875760546642816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 200us (331us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788864896.215642:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788864896.215661:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788864896.215688:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fdcafc98a80/2, rc 0, transno 4294967303 00000100:00100000:0.0:1788864896.215694:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcafc98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546642816:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788864896.215855:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+17:10482:x1875760528794752:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 92149us (92318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864896.215864:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:0.0:1788864896.217622:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546642944:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788864896.217673:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864896.217816:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546642944 00000100:00100000:3.0:1788864896.217824:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546642944 00000100:00100000:3.0:1788864896.217904:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788864896.217915:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafc98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1875760546642944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788864896.217935:0:8199:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1788864896.217966:0:8199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9fe97b, atime: 0x6a9fe97b, ctime: 0x6a9fe97b, blocks: 0x1 00010000:00010000:3.0:1788864896.217973:0:8199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9fb882e/0xf8c13e2d0e95977e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.218001:0:8199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=319s v=(0 0) 00010000:00010000:3.0:1788864896.218005:0:8199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788864896.218011:0:8199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9fb882e/0xf8c13e2d0e95977e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.218041:0:8199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9fb882e/0xf8c13e2d0e95977e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.218051:0:8199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9fb882e/0xf8c13e2d0e95977e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.218058:0:8199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9fb882e/0xf8c13e2d0e95977e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.218075:0:8199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1788864896.218734:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:1.0:1788864896.219274:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fdcbc4ff240 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788864896.219279:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fdcc00b6400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fdcbc4fff00 00000020:00080000:1.0:1788864896.219282:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fdcc00b6200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fdcbcbf4800 00000020:00080000:1.0:1788864896.219314:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788864896.219391:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788864896.220607:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864896.220641:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528794880 00000100:00100000:1.0:1788864896.220649:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528794880 00000100:00100000:1.0:1788864896.220692:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:1.0:1788864896.220724:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca0d5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2359:x1875760528794880:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788864896.222569:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafc98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3303:x1875760546642944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4649us (4888us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788864896.222582:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1788864896.223107:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fdc86eb8700/2, rc 0, transno 4294967301 00000100:00100000:1.0:1788864896.223115:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546642944:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788864896.227232:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788864896.227247:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9fb882e/0xf8c13e2d0e95977e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.227555:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213f600 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:3.0:1788864896.227562:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9fb882e/0xf8c13e2d0e95977e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.227574:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9fb882e/0xf8c13e2d0e95977e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.227594:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9fb882e/0xf8c13e2d0e95977e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.227612:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9fb882e/0xf8c13e2d0e95977e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.227636:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864896.227638:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864896.227640:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788864896.271361:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1788864896.271382:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1788864896.271682:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca0d5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2359:x1875760528794880:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 50976us (51075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864896.271693:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:1.0:1788864896.277318:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864896.279446:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528795136 00000100:00100000:2.0:1788864896.279460:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528795136 00000100:00100000:2.0:1788864896.279592:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:2.0:1788864896.279604:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca0d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+13:10482:x1875760528795136:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788864896.280272:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864896.280302:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e959769 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbd5 expref: 13 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.280326:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fdc9124e400) 00010000:00010000:3.0:1788864896.280331:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788864896.280363:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959785 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.280378:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.280388:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788864896.281384:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000582ce57 reply state 00000000ac611c0d transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864896.281399:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788864896.281544:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca0d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+14:10482:x1875760528795136:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 1940us (4233us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788864896.281552:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 81 00010000:00010000:1.0:1788864896.286508:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.286526:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959785 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.286534:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959785 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.286540:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213f600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864896.286545:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959785 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.286552:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959785 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.286569:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fdc9124e400) 00010000:00010000:1.0:1788864896.286585:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864896.286591:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959785 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.286597:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959785 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864896.288925:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864896.289387:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528795264 00000100:00100000:1.0:1788864896.289398:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528795264 00000100:00100000:1.0:1788864896.289463:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:1.0:1788864896.289473:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafc99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2358:x1875760528795264:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788864896.290327:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788864896.290333:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788864895 -> 1788864893 00002000:00010000:1.0:1788864896.290336:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788864891 00002000:00010000:1.0:1788864896.290339:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788864895 -> 1788864893 00002000:00010000:1.0:1788864896.290341:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788864896.290404:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafc99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2358:x1875760528795264:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 931us (1487us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788864896.290414:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:0.0:1788864896.296129:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864896.296222:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528795520 00000100:00100000:3.0:1788864896.296231:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528795520 00000100:00100000:3.0:1788864896.296291:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:3.0:1788864896.296302:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafc9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+13:10482:x1875760528795520:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788864896.296366:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e95978c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.296384:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959746 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbc7 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.296393:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e95978c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.296428:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959746 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbc7 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.296441:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959746 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbc7 expref: 13 pid: 5837 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864896.296454:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6705:1875760546643072:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788864896.296569:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc84e8fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788864896.306365:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6705:1875760546643072:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788864896.306399:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e95978c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864896.308250:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864896.308439:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528795648 00000100:00100000:2.0:1788864896.308449:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528795648 00010000:00010000:2.0:1788864896.308503:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959746 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbc7 expref: 14 pid: 5837 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864896.308539:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:2.0:1788864896.308548:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafc98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+14:2359:x1875760528795648:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788864896.308576:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864896.308583:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959746 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbc7 expref: 14 pid: 5837 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.308596:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959746 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbc7 expref: 14 pid: 5837 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.308617:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959746 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbc7 expref: 14 pid: 5837 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.308632:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fdc9124e400) 00010000:00010000:2.0:1788864896.308637:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e95978c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.308646:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e95978c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.308654:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e95978c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.308685:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864896.308781:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafc98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+13:2359:x1875760528795648:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 233us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864896.308789:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00010000:00010000:3.0:1788864896.309227:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e95978c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.309237:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e95978c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.309274:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e95978c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.309282:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e95978c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.309288:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e95978c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.309294:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213e600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864896.309298:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e95978c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.309305:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e95978c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.309315:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fdc9124e400) 00010000:00010000:3.0:1788864896.309318:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788864896.309322:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e95978c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864896.309329:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e95978c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864896.309384:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafc9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+12:10482:x1875760528795520:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 Request processed in 13084us (13385us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788864896.309392:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:0.0:1788864896.315096:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864896.315232:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528795776 00000100:00100000:2.0:1788864896.315242:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528795776 00000100:00100000:2.0:1788864896.315297:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:2.0:1788864896.315307:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2358:x1875760528795776:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788864896.315364:0:8199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db125696/0xf8c13e2d0e959793 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.315383:0:8199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959777 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbe3 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.315392:0:8199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864896.315397:0:8199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788864896.315401:0:8199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db125696/0xf8c13e2d0e959793 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.315437:0:8199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959777 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbe3 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.315450:0:8199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959777 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbe3 expref: 7 pid: 6685 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864896.315464:0:8199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc063a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8199:1875760546643200:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788864896.315693:0:8199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc913750c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864896.338205:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864896.338287:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528795904 00000100:00100000:1.0:1788864896.338298:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528795904 00010000:00010000:1.0:1788864896.338342:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959777 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbe3 expref: 8 pid: 6685 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864896.338388:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:1.0:1788864896.338399:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafc99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2359:x1875760528795904:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864896.338415:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864896.338437:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959777 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbe3 expref: 8 pid: 6685 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.338470:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959777 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbe3 expref: 8 pid: 6685 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.338504:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788864896.338508:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788864896.338515:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db125696/0xf8c13e2d0e959793 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.338526:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db125696/0xf8c13e2d0e959793 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.338548:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864896.338773:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafc99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2359:x1875760528795904:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 375us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864896.338782:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00010000:00010000:2.0:1788864896.342218:0:8199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959777 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbe3 expref: 7 pid: 6685 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864896.342243:0:8199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc063a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8199:1875760546643200:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788864896.342327:0:8199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db125696/0xf8c13e2d0e959793 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.342430:0:8199:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db125696/0xf8c13e2d0e959793 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.342438:0:8199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db125696/0xf8c13e2d0e959793 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.342471:0:8199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db125696/0xf8c13e2d0e959793 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.342480:0:8199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db125696/0xf8c13e2d0e959793 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.342634:0:8199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db125696/0xf8c13e2d0e959793 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.342641:0:8199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384600 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:2.0:1788864896.342645:0:8199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db125696/0xf8c13e2d0e959793 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.342654:0:8199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db125696/0xf8c13e2d0e959793 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.342672:0:8199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db125696/0xf8c13e2d0e959793 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.342692:0:8199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db125696/0xf8c13e2d0e959793 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864896.342865:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2358:x1875760528795776:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 27558us (27778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864896.342874:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:2.0:1788864896.347858:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864896.348078:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528796160 00000100:00100000:1.0:1788864896.348088:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528796160 00000100:00100000:1.0:1788864896.348143:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:1.0:1788864896.348152:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc063a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+12:10482:x1875760528796160:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788864896.348224:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95979a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.348240:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95979a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.348251:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95979a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.348483:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9597a1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.348804:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e959754 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbce expref: 13 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.348813:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9597a1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.348848:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e959754 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbce expref: 13 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.348863:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e959754 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbce expref: 13 pid: 6705 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864896.348877:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca0d5c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875760546643328:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788864896.348971:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc873c1300 going to sleep for 11 seconds 00000100:00100000:1.0:1788864896.353692:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca0d5c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875760546643328:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788864896.353759:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9597a1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864896.355749:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864896.356208:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528796288 00000100:00100000:1.0:1788864896.356219:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528796288 00010000:00010000:1.0:1788864896.356269:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e959754 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbce expref: 14 pid: 6705 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864896.356308:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:1.0:1788864896.356318:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+14:2359:x1875760528796288:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864896.356357:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864896.356365:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e959754 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbce expref: 14 pid: 6705 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.356379:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e959754 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbce expref: 14 pid: 6705 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.356399:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e959754 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbce expref: 14 pid: 6705 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.356414:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fdc9124e400) 00010000:00010000:1.0:1788864896.356419:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9597a1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.356429:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9597a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.356436:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9597a1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.356469:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864896.356536:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+13:2359:x1875760528796288:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 219us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864896.356544:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00010000:00010000:0.0:1788864896.356737:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9597a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.356745:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9597a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788864896.356947:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1788864896.357290:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1788864896.357340:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1788864896.357416:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcafc99500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5836:1875760546643456:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788864896.357466:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864896.357494:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcacaa7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788864896.358179:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546643456 00000100:00100000:1.0:1788864896.358187:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546643456 00000100:00100000:1.0:1788864896.358248:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788864896.358256:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875760546643456:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788864896.358335:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875760546643456:12345-0@lo:1000:mdt00_001.0 Request processed in 79us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864896.358361:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788864896.358610:0:5836:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1788864896.358615:0:5836:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fdcafc98a80, transno 4294967303 00000100:00100000:0.0:1788864896.358637:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcafc99500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5836:1875760546643456:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788864896.360080:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1788864896.360153:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcafc99500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5836:1875760546643584:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788864896.360204:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864896.360232:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcacaa7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788864896.361478:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546643584 00000100:00100000:1.0:1788864896.361498:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546643584 00000100:00100000:1.0:1788864896.361557:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788864896.361567:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafc99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875760546643584:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788864896.361799:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafc99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1875760546643584:12345-0@lo:1000:mdt00_001.0 Request processed in 233us (1593us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788864896.361807:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788864896.362144:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcafc99500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5836:1875760546643584:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788864896.362184:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9597a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.362194:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9597a1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.362218:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9597a1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.362225:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864896.362230:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9597a1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.362238:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9597a1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.362253:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fdc9124e400) 00010000:00010000:0.0:1788864896.362256:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788864896.362261:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9597a1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.362471:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9597a1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.362517:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9596cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.362523:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9596cf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.362529:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9596cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.362534:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4b000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864896.362538:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9596cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.362554:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9596cf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.362563:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57a00) 00010000:00010000:0.0:1788864896.362566:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788864896.362569:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9596cf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.362574:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9596cf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.362593:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9597a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.362606:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9596eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbb2 expref: 16 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.362616:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9597a8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.362645:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9596eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbb2 expref: 16 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.362659:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9596eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbb2 expref: 16 pid: 6705 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864896.362670:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcafc98a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875760546643712:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788864896.362762:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcacaa7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788864896.367793:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864896.368030:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528796416 00000100:00100000:1.0:1788864896.368040:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528796416 00010000:00010000:1.0:1788864896.368081:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9596eb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbb2 expref: 17 pid: 6705 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864896.368122:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:1.0:1788864896.368133:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+17:2358:x1875760528796416:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864896.368146:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864896.368154:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9596eb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbb2 expref: 17 pid: 6705 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.368167:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9596eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbb2 expref: 17 pid: 6705 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.368187:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57a00) 00010000:00010000:1.0:1788864896.368192:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9597a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.368201:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9597a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.368220:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9597a8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864896.368238:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864896.368299:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+17:2358:x1875760528796416:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 167us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864896.368307:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00010000:00010000:0.0:1788864896.368911:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9596eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbb2 expref: 16 pid: 6705 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864896.368938:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcafc98a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875760546643712:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788864896.368956:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9597a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.368965:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9597a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.368972:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9597a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.368993:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9597a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.369000:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9597a8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.369007:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9597a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.369012:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864896.369016:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9597a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.369023:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9597a8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.369032:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57a00) 00010000:00010000:0.0:1788864896.369035:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864896.369039:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9597a8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.369055:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9597a8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.369066:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95979a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.369072:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95979a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.369078:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95979a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.369084:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864896.369086:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95979a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.369092:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95979a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.369099:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57a00) 00010000:00010000:0.0:1788864896.369102:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788864896.369105:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95979a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.369111:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95979a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864896.369324:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc063a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+15:10482:x1875760528796160:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 21172us (21476us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1788864896.369332:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 83 00000020:00080000:0.0:1788864896.369343:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788864896.369567:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788864896.369572:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788864896.369594:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788864896.369599:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788864896.376191:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864896.376288:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528796672 00000100:00100000:0.0:1788864896.376299:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528796672 00000100:00100000:0.0:1788864896.376362:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:0.0:1788864896.376372:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+15:10482:x1875760528796672:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788864896.377492:0:5838:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788864896.377639:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1788864896.377691:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9597af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.377748:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9597af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.377762:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9597af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.377771:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9597af lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.377777:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9597af lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.377783:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9597af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864896.378179:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788864896.378290:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+17:10482:x1875760528796672:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 1917us (2105us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788864896.378299:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000020:00080000:0.0:1788864896.378305:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788864896.382339:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864896.382411:0:11155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9597af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.382423:0:11155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4b000 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:2.0:1788864896.382427:0:11155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9597af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.382438:0:11155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9597af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.382456:0:11155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fdca4f57400) 00010000:00010000:2.0:1788864896.382459:0:11155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788864896.382464:0:11155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9597af lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.382470:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9597af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864896.382573:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864896.382575:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864896.382577:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864896.582157:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864897.358345:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546643840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788864897.358410:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864897.358491:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546643840 00000100:00100000:3.0:1788864897.358498:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546643840 00000100:00100000:3.0:1788864897.358538:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788864897.358546:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875760546643840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788864897.358566:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1788864897.358604:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875760546643840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864897.358611:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788864897.358654:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546643840:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788864897.410083:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:3.0:1788864897.410174:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:3.0:1788864897.410325:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:2.0:1788864897.612430:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788864897.615746:0:12040:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788864897.615755:0:12040:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788864897.615793:0:12040:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788864897.615800:0:12040:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788864897.809624:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864897.811131:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528796928 00000100:00100000:1.0:1788864897.811144:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528796928 00000100:00100000:1.0:1788864897.811216:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:1.0:1788864897.811227:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+17:10500:x1875760528796928:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788864897.811249:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864897.811267:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9597b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fbea expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864897.811358:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74400/0xf8c13e2d0e9597bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864897.811372:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74400/0xf8c13e2d0e9597bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864897.811384:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74400/0xf8c13e2d0e9597bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864897.811408:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000100:00080000:2.0:1788864897.811826:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788864897.813201:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e9597b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbea expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864897.813227:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74400/0xf8c13e2d0e9597bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbea expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864897.813235:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:1.0:1788864897.813238:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788864897.813242:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc74400, rc 0) 00000100:00100000:1.0:1788864897.813313:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+19:10500:x1875760528796928:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 2088us (3697us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788864897.813322:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:1.0:1788864897.817612:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864897.817763:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528797056 00000100:00100000:0.0:1788864897.817781:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528797056 00000100:00100000:0.0:1788864897.817834:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:0.0:1788864897.817843:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca0d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+19:10500:x1875760528797056:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:0.0:1788864897.817909:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9597cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.817924:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9597cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.818557:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9597cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.818583:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9597d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.818591:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9597d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.818600:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9597d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.818833:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e9597d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.818842:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e9597d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.818849:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e9597d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788864897.818886:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e9597d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.818906:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9597cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.818912:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9597cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.818919:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9597cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.818925:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864897.818929:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9597cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.819120:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9597cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.819135:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:0.0:1788864897.819138:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864897.819143:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9597cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.819148:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e9597cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.819160:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9597d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.819166:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9597d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.819172:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9597d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.819184:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4b200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864897.819187:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9597d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.819193:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9597d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.819200:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fdca4f57000) 00010000:00010000:0.0:1788864897.819203:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864897.819205:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9597d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.819211:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e9597d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.819574:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e9597d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.819581:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e9597d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.819587:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e9597d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.819592:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864897.819595:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e9597d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.819600:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e9597d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.819619:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdca4f57900) 00010000:00010000:0.0:1788864897.819622:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864897.819625:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e9597d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.819630:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e9597d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864897.819762:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca0d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+19:10500:x1875760528797056:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 1917us (2157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864897.819770:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:1.0:1788864897.884860:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864897.884951:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528797312 00000100:00100000:3.0:1788864897.884962:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528797312 00000100:00100000:3.0:1788864897.885042:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:3.0:1788864897.885053:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca0d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+19:10503:x1875760528797312:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788864897.885074:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864897.885094:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9597e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fbf1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.885164:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e9597e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.885195:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e9597e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.885209:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e9597e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.885224:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e9597ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.885231:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e9597ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.885239:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e9597ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.885679:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9597f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.885689:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9597f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.885696:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9597f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788864897.885732:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788864897.885820:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e9597e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.885828:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e9597e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.885835:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e9597e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.885848:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213ea00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864897.885853:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e9597e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.885861:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e9597e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.885874:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:3.0:1788864897.885877:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864897.885882:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e9597e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.885887:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e9597e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.885899:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e9597ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.885905:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e9597ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.885910:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e9597ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.885915:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213e400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864897.885918:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e9597ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.885924:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e9597ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.886007:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fdc834b8a00) 00010000:00010000:3.0:1788864897.886010:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864897.886013:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e9597ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.886018:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e9597ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.886058:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9597e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbf1 expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.886072:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9597f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbf1 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.886078:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdc834b8800) 00010000:00010000:3.0:1788864897.886080:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788864897.886083:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213e600, rc 0) 00000100:00100000:3.0:1788864897.886146:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca0d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+21:10503:x1875760528797312:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1094us (1295us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788864897.886154:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:0.0:1788864897.900374:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864897.900411:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528797440 00000100:00100000:0.0:1788864897.900421:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528797440 00000100:00100000:0.0:1788864897.900470:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:0.0:1788864897.900480:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafc98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+21:10503:x1875760528797440:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:0.0:1788864897.900543:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959803 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.900560:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.900573:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.900598:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.900606:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959803 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.900624:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959803 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.900630:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4b200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864897.900635:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959803 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.900642:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959803 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.900653:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdc834b8800) 00010000:00010000:0.0:1788864897.900656:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788864897.900661:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959803 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864897.900668:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959803 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864897.900755:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafc98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+21:10503:x1875760528797440:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 276us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864897.900763:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:0.0:1788864897.915449:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864897.917256:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528797696 00000100:00100000:2.0:1788864897.917270:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528797696 00000100:00100000:2.0:1788864897.917338:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:2.0:1788864897.917348:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca21f4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+21:10503:x1875760528797696:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788864897.917577:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca21f4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+22:10503:x1875760528797696:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 230us (2137us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788864897.917585:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:0.0:1788864897.981040:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864897.981125:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528797952 00000100:00100000:3.0:1788864897.981134:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528797952 00000100:00100000:3.0:1788864897.981190:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:3.0:1788864897.981200:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafc98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+22:10023:x1875760528797952:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1788864897.981232:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864897.981254:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95980a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fbf8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.981366:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959811 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.981381:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9597f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbf1 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.981389:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959811 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.981438:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9597f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbf1 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864897.981450:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9597f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbf1 expref: 23 pid: 5837 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864897.981463:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875760546643968:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788864897.981552:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc84e8ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788864897.984239:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864897.984353:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528798080 00000100:00100000:2.0:1788864897.984361:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528798080 00010000:00010000:2.0:1788864897.984399:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9597f5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbf1 expref: 24 pid: 5837 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864897.984437:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:2.0:1788864897.984447:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+24:2359:x1875760528798080:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788864897.984460:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864897.984467:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9597f5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbf1 expref: 24 pid: 5837 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864897.984480:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9597f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbf1 expref: 24 pid: 5837 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864897.984517:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdc834b8800) 00010000:00010000:2.0:1788864897.984522:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959811 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864897.984531:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959811 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864897.984540:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959811 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864897.984558:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864897.984611:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+24:2359:x1875760528798080:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 165us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864897.984619:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00010000:00010000:1.0:1788864897.985072:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9597f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbf1 expref: 23 pid: 5837 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864897.985089:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875760546643968:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788864897.985109:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959811 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864897.985118:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959811 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864897.985125:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959811 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864897.985153:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788864897.985920:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95980a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbf8 expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864897.986401:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959811 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbf8 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864897.986412:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdc834b8800) 00010000:00010000:1.0:1788864897.986415:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788864897.986419:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213ea00, rc 0) 00000100:00100000:1.0:1788864897.986654:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafc98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+23:10023:x1875760528797952:12345-192.168.203.13@tcp:101:bash.0 Request processed in 5453us (5622us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788864897.986664:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:0.0:1788864898.006329:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864898.007023:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528798336 00000100:00100000:1.0:1788864898.007034:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528798336 00000100:00100000:1.0:1788864898.007094:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00100000:1.0:1788864898.007104:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+23:10023:x1875760528798336:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:1.0:1788864898.007380:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95981f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.007398:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95981f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.007410:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95981f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788864898.007463:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1788864898.008642:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a514c86 reply state 000000005d13a58a transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95981f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864898.008654:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788864898.009087:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1788864898.009223:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+27:10023:x1875760528798336:12345-192.168.203.13@tcp:36:bash.0 Request processed in 2117us (2899us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1788864898.009231:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 89 00000020:00080000:1.0:1788864898.009235:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788864898.011659:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95981f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.011687:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95981f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.011695:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95981f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.011824:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864898.011845:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95981f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.011854:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95981f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.012212:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdc834b8800) 00010000:00010000:1.0:1788864898.012216:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864898.012222:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95981f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.012229:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95981f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864898.012694:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864898.013271:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528798464 00000100:00100000:1.0:1788864898.013281:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528798464 00000100:00100000:1.0:1788864898.013341:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:1.0:1788864898.013351:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+26:10023:x1875760528798464:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788864898.013374:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864898.013391:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959826 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fbff expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.013445:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959826 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbff expref: 27 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.013460:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959826 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbff expref: 27 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.013478:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdc834b8800) 00010000:00010000:1.0:1788864898.018419:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788864898.018429:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc75000, rc 0) 00000100:00100000:0.0:1788864898.018609:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+27:10023:x1875760528798464:12345-192.168.203.13@tcp:101:bash.0 Request processed in 5254us (5914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864898.018619:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:2.0:1788864898.022993:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864898.023157:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528798592 00000100:00100000:1.0:1788864898.023167:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528798592 00000100:00100000:1.0:1788864898.023239:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:1.0:1788864898.023248:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:10023:x1875760528798592:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788864898.023265:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864898.023284:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e95982d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fc06 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788864898.023309:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9fe97d, atime: 0x6a9fe97b, ctime: 0x6a9fe97d, blocks: 0xb 00010000:00010000:1.0:1788864898.023341:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=321s v=(0 0) 00010000:00010000:1.0:1788864898.023346:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864898.023354:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e95982d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc06 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.023372:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e95982d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc06 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.023383:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc75200, rc 0) 00000100:00100000:1.0:1788864898.023441:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:10023:x1875760528798592:12345-192.168.203.13@tcp:101:bash.0 Request processed in 194us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864898.023448:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00080000:2.0:1788864898.023754:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788864898.031103:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864898.031202:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528798720 00000100:00100000:2.0:1788864898.031213:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528798720 00002000:00010000:2.0:1788864898.031253:0:6688:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788864898.031258:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fdcac9cce00 with x1875760528798720 ext(0->18446744073709551615) 00002000:00010000:2.0:1788864898.031270:0:6688:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fdcac9cce00. 00000100:00100000:2.0:1788864898.031346:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:2.0:1788864898.031356:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2356:x1875760528798720:12345-192.168.203.13@tcp:10:bash.0 00002000:00010000:2.0:1788864898.031621:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788864898.031625:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788864893 -> 1788864897 00002000:00010000:2.0:1788864898.031628:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788864891 -> 1788864891 00002000:00010000:2.0:1788864898.031630:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788864893 -> 1788864897 00002000:00010000:2.0:1788864898.031644:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788864898.031743:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2356:x1875760528798720:12345-192.168.203.13@tcp:10:bash.0 Request processed in 387us (650us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788864898.031750:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00002000:00010000:2.0:1788864898.031754:0:6688:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788864898.031757:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fdcac9cce00 with x1875760528798720 ext(0->18446744073709551615) 00002000:00010000:2.0:1788864898.031762:0:6688:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fdcac9cce00. 00000100:00100000:0.0:1788864898.146421:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864898.146541:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528798848 00000100:00100000:2.0:1788864898.146551:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528798848 00000100:00100000:2.0:1788864898.146613:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:2.0:1788864898.146624:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+27:10517:x1875760528798848:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:2.0:1788864898.146695:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959834 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.146746:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959834 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.146757:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959834 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.146773:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e95983b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.146780:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e95983b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.146786:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e95983b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.147018:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959842 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.147032:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.147040:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788864898.147091:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.147104:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959834 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.147111:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959834 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.147118:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959834 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.147124:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864898.147128:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959834 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.147136:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959834 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.147147:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:2.0:1788864898.147150:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864898.147155:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959834 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.147161:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959834 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.147180:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e95983b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.147186:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e95983b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.147192:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e95983b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.147198:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864898.147201:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e95983b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.147207:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e95983b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.147215:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fdc9124e500) 00010000:00010000:2.0:1788864898.147218:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864898.147221:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e95983b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.147226:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e95983b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.147241:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.147248:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959842 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.147254:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959842 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.147265:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864898.147269:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959842 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.147275:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959842 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.147283:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdc834b8800) 00010000:00010000:2.0:1788864898.147285:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864898.147288:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959842 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.147294:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959842 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864898.147374:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+27:10517:x1875760528798848:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 750us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864898.147384:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:0.0:1788864898.186825:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864898.188530:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528799104 00000100:00100000:3.0:1788864898.188544:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528799104 00000100:00100000:3.0:1788864898.188613:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 92 00000100:00100000:3.0:1788864898.188623:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+27:10520:x1875760528799104:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788864898.188643:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864898.188662:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e959849 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fc0d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.188776:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959850 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.188790:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959850 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.188802:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959850 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.188816:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959857 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.188823:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.188841:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.189112:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e95985e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.189122:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e95985e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.189130:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e95985e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788864898.189140:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788864898.189231:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959850 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.189238:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959850 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.189250:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959850 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.189256:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213f600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864898.189261:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959850 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.189268:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959850 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.189281:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:3.0:1788864898.189284:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864898.189289:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959850 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.189295:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959850 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.189307:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.189312:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959857 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.189317:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959857 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.189321:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213ec00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864898.189323:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959857 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.189338:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959857 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.189345:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fdc834b8a00) 00010000:00010000:3.0:1788864898.189347:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864898.189350:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959857 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.189355:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959857 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.189391:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e959849 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc0d expref: 30 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.189403:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e95985e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc0d expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.189411:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdc834b8800) 00010000:00010000:3.0:1788864898.189413:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788864898.189415:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213e600, rc 0) 00000100:00100000:3.0:1788864898.189491:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+29:10520:x1875760528799104:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 869us (2675us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788864898.189499:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 92 00000100:00100000:3.0:1788864898.198359:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864898.198503:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528799232 00000100:00100000:2.0:1788864898.198519:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528799232 00000100:00100000:2.0:1788864898.198607:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:2.0:1788864898.198621:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+29:10520:x1875760528799232:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:2.0:1788864898.198801:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95986c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.198824:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959811 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbf8 expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.198835:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95986c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.198903:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959811 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbf8 expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.198918:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959811 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbf8 expref: 29 pid: 5837 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864898.198934:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcb7ff7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875760546644096:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788864898.199177:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc873c1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788864898.202962:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864898.203076:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528799488 00000100:00100000:0.0:1788864898.203091:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528799488 00000100:00100000:0.0:1788864898.203165:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:0.0:1788864898.203176:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca0d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+30:5594:x1875760528799488:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788864898.203352:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcb7ff7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875760546644096:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788864898.203388:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95986c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864898.204226:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca0d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+31:5594:x1875760528799488:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 1047us (1270us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788864898.204237:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:0.0:1788864898.207270:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864898.207431:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528799616 00000100:00100000:2.0:1788864898.207444:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528799616 00010000:00010000:2.0:1788864898.207510:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959811 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbf8 expref: 31 pid: 5837 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864898.207561:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:2.0:1788864898.207574:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+31:2359:x1875760528799616:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788864898.207594:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864898.207602:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959811 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbf8 expref: 31 pid: 5837 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.207617:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959811 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbf8 expref: 31 pid: 5837 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.207669:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959811 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbf8 expref: 31 pid: 5837 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.207701:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdc834b8800) 00010000:00010000:2.0:1788864898.207756:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95986c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.207767:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95986c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.207776:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95986c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.207819:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864898.207897:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+30:2359:x1875760528799616:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 324us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864898.207905:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00010000:00010000:1.0:1788864898.208191:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95986c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.208200:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95986c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.208243:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95986c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.208250:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95986c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.208257:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95986c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.208263:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864898.208283:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95986c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.208291:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95986c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.208301:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdc834b8800) 00010000:00010000:1.0:1788864898.208304:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788864898.208308:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95986c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.208314:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e95986c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864898.208374:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+29:10520:x1875760528799232:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 9756us (10036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864898.208383:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:0.0:1788864898.213462:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864898.213642:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528799872 00000100:00100000:1.0:1788864898.213656:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528799872 00000100:00100000:0.0:1788864898.214114:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:0.0:1788864898.214136:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+29:10520:x1875760528799872:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1788864898.214445:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+30:10520:x1875760528799872:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 320us (997us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788864898.214453:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:2.0:1788864898.300155:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864898.300440:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528800128 00000100:00100000:3.0:1788864898.300454:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528800128 00000100:00100000:3.0:1788864898.300610:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:3.0:1788864898.300625:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+30:10531:x1875760528800128:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:3.0:1788864898.300675:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864898.300824:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959873 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fc14 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.300921:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95987a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.300941:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95987a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.300954:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95987a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.301074:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959881 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.301083:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.301091:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.301516:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959888 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.301526:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.301535:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788864898.301547:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788864898.301669:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95987a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.301679:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95987a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.301686:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95987a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.301693:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213f600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864898.301699:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95987a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.301821:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95987a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.301835:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:3.0:1788864898.301838:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864898.301844:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95987a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.301851:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95987a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.301866:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.301873:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959881 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.301879:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959881 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.301884:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213f800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864898.301894:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959881 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.301901:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959881 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.301910:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fdc834b8a00) 00010000:00010000:3.0:1788864898.301912:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864898.301915:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959881 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.301921:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959881 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.302055:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959873 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc14 expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.302074:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc14 expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.302082:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdc834b8800) 00010000:00010000:3.0:1788864898.302084:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788864898.302087:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213ea00, rc 0) 00000100:00100000:3.0:1788864898.302177:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+32:10531:x1875760528800128:12345-192.168.203.13@tcp:101:cat.0 Request processed in 1555us (2035us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788864898.302187:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:1.0:1788864898.312476:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864898.319083:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528800384 00000100:00100000:2.0:1788864898.319105:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528800384 00000100:00100000:2.0:1788864898.319191:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:2.0:1788864898.319203:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca0d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+32:10531:x1875760528800384:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:2.0:1788864898.319552:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca0d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+33:10531:x1875760528800384:12345-192.168.203.13@tcp:35:cat.0 Request processed in 349us (7089us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788864898.319561:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:0.0:1788864898.354256:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864898.354878:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528800640 00000100:00100000:1.0:1788864898.354892:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528800640 00000100:00100000:1.0:1788864898.354986:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 95 00000100:00100000:1.0:1788864898.354998:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+33:10532:x1875760528800640:12345-192.168.203.13@tcp:36:rm.0 00010000:00010000:1.0:1788864898.355071:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788864898.355108:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959888 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc14 expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.355136:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e95985e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc0d expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.355177:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959826 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbff expref: 31 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.355190:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdc834b8800) 00010000:00010000:1.0:1788864898.355204:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788864898.355230:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959896 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.355246:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959896 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.355256:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959896 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.355270:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95989d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.355276:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95989d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.355282:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95989d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.355593:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9598a4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.355602:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9598a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.355609:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9598a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788864898.358620:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1788864898.358638:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 321489933676ns, next at 322489929521ns, rc = 0 00010000:00010000:1.0:1788864898.358766:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9598ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.358787:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9598ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.358801:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9598ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.358811:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9598ab lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.358818:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9598ab lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.358824:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9598ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.358852:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788864898.358882:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9598a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.358888:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9598a4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.358895:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9598a4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.358900:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864898.358917:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9598a4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.358925:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9598a4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.358939:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:1.0:1788864898.358942:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788864898.358948:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9598a4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.358954:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9598a4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.358994:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959896 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.359001:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959896 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.359007:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959896 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.359012:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864898.359015:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959896 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.359021:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959896 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.359024:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788864898.359028:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:1.0:1788864898.359030:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864898.359032:0:11155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9598ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.359041:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959896 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.359044:0:11155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74000 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:2.0:1788864898.359047:0:11155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9598ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.359048:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959896 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.359054:0:11155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9598ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.359063:0:11155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:2.0:1788864898.359066:0:11155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788864898.359069:0:11155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9598ab lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.359074:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e9598ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.359092:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864898.359094:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864898.359096:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1788864898.359621:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b011f3b0 reply state 00000000a3921d45 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95989d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864898.359633:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788864898.359862:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+32:10532:x1875760528800640:12345-192.168.203.13@tcp:36:rm.0 Request processed in 4860us (5616us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788864898.359873:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 95 00010000:00010000:1.0:1788864898.363233:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95989d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.363255:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95989d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.363264:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95989d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.363270:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864898.363276:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95989d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.363285:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95989d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.363305:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fdc8328e600) 00010000:00010000:1.0:1788864898.363309:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864898.363315:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95989d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.363343:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95989d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864898.373294:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546644352:0@lo:400:kworker.0 00000100:00100000:2.0:1788864898.373415:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864898.373502:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546644864:0@lo:400:kworker.0 00000100:00100000:2.0:1788864898.373535:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864898.373574:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788864898.373582:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546644480:0@lo:400:kworker.0 00000100:00100000:2.0:1788864898.373606:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864898.373733:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546644352 00000100:00100000:3.0:1788864898.373745:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546644352 00000100:00100000:3.0:1788864898.373808:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546644480 00000100:00100000:3.0:1788864898.373812:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546644480 00000100:00080000:3.0:1788864898.373869:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864898.373899:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788864898.373910:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86ebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546644352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864898.373986:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86ebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546644352:12345-0@lo:400:kworker.0 Request processed in 77us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864898.373994:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788864898.374013:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788864898.374020:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546644480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864898.374047:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546644480:12345-0@lo:400:kworker.0 Request processed in 29us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864898.374054:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788864898.374347:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546644608:0@lo:400:kworker.0 00000100:00100000:1.0:1788864898.374387:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864898.374430:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788864898.374436:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546644224:0@lo:400:kworker.0 00000100:00100000:1.0:1788864898.374482:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864898.374504:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546644736:0@lo:400:kworker.0 00000100:00100000:1.0:1788864898.374528:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864898.374560:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546644736 00000100:00100000:1.0:1788864898.374564:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546644736 00000100:00100000:1.0:1788864898.374600:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788864898.374606:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca0d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546644736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864898.374644:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca0d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546644736:12345-0@lo:400:kworker.0 Request processed in 38us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864898.374651:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788864898.374692:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546644736:0@lo:400:kworker.0 00000100:00100000:2.0:1788864898.374962:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546644480:0@lo:400:kworker.0 00000100:00100000:2.0:1788864898.374987:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546644352:0@lo:400:kworker.0 00000100:00100000:0.0:1788864898.375107:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546644864 00000100:00100000:0.0:1788864898.375113:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546644864 00000100:00100000:0.0:1788864898.375157:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546644608 00000100:00100000:0.0:1788864898.375160:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546644608 00000100:00100000:0.0:1788864898.375187:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788864898.375196:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0629500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546644864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864898.375249:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0629500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546644864:12345-0@lo:400:kworker.0 Request processed in 54us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864898.375256:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788864898.375278:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788864898.375291:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca0d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1875760546644608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864898.375331:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca0d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1875760546644608:12345-0@lo:400:kworker.0 Request processed in 39us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864898.375337:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788864898.375357:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546644224 00000100:00100000:0.0:1788864898.375361:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546644224 00000100:00100000:0.0:1788864898.375388:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788864898.375394:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3300:x1875760546644224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864898.375424:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3300:x1875760546644224:12345-0@lo:400:kworker.0 Request processed in 30us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864898.375430:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788864898.375669:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546644224:0@lo:400:kworker.0 00000100:00100000:0.0:1788864898.375683:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546644608:0@lo:400:kworker.0 00000100:00100000:0.0:1788864898.375770:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1788864898.375777:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1788864898.375798:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fdc86eb8700, transno 4294967301 00000100:00100000:0.0:1788864898.375815:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546644864:0@lo:400:kworker.0 00000100:00080000:3.0:1788864898.375950:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788864898.375955:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788864898.375958:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788864898.424273:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864898.424742:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528800896 00000100:00100000:1.0:1788864898.424767:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528800896 00000100:00100000:1.0:1788864898.424857:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 96 00000100:00100000:1.0:1788864898.424870:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+31:10538:x1875760528800896:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788864898.424904:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864898.424932:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e9598b2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fc1b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.425126:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e9598b9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.425145:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e9598b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.425160:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e9598b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.425177:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9598c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.425185:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9598c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.425192:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9598c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788864898.425984:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788864898.426218:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e9598c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.426235:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e9598c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.426246:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e9598c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.426293:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e9598b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.426315:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e9598b9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.426323:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e9598b9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.426331:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864898.426336:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e9598b9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.426346:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e9598b9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.426360:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:1.0:1788864898.426364:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864898.426370:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e9598b9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.426378:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e9598b9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788864898.426395:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010e33dc4 reply state 00000000851247ab transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9598c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864898.426406:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788864898.426450:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e9598b2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc1b expref: 34 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.426466:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e9598c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc1b expref: 33 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.426486:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e100) 00010000:00010000:1.0:1788864898.426489:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788864898.426492:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc75000, rc 0) 00000100:00100000:1.0:1788864898.426609:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+34:10538:x1875760528800896:12345-192.168.203.13@tcp:101:bash.0 Request processed in 1741us (2348us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788864898.426619:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 96 00010000:00010000:1.0:1788864898.430229:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9598c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.430253:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9598c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.430263:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9598c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.430270:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864898.430276:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9598c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.430286:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9598c0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.430307:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fdc8328e600) 00010000:00010000:1.0:1788864898.430310:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864898.430315:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9598c0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.430323:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e9598c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864898.435168:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864898.435277:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528801024 00000100:00100000:2.0:1788864898.435291:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528801024 00000100:00100000:2.0:1788864898.435376:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00080000:3.0:1788864898.435404:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788864898.435412:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2358:x1875760528801024:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1788864898.435436:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864898.435463:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e9598d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fc22 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788864898.435509:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788864898.435541:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=321s v=(0 0) 00010000:00010000:2.0:1788864898.435546:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864898.435556:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e9598d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc22 expref: 6 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.435581:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e9598d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc22 expref: 6 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.435596:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385200, rc 0) 00000100:00100000:3.0:1788864898.436268:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2358:x1875760528801024:12345-192.168.203.13@tcp:101:bash.0 Request processed in 878us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864898.436289:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:3.0:1788864898.441380:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864898.441499:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528801152 00000100:00100000:0.0:1788864898.441512:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528801152 00000100:00100000:0.0:1788864898.441617:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:0.0:1788864898.441629:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:10538:x1875760528801152:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788864898.441661:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864898.441688:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000946579a6/0xf8c13e2d0e9598dc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fc29 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864898.441810:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e9598d5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc22 expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864898.441821:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788864898.441825:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788864898.441841:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000946579a6/0xf8c13e2d0e9598dc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc29 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864898.441885:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e9598d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc22 expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864898.441901:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e9598d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc22 expref: 7 pid: 6684 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864898.441917:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0086300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1875760546644992:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788864898.442041:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca8d28c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788864898.446508:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864898.446766:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528801280 00000100:00100000:1.0:1788864898.446780:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528801280 00010000:00010000:1.0:1788864898.446851:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e9598d5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc22 expref: 8 pid: 6684 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864898.446900:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:1.0:1788864898.446911:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2359:x1875760528801280:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864898.446928:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864898.446958:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e9598d5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc22 expref: 8 pid: 6684 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.446985:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e9598d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc22 expref: 8 pid: 6684 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.447017:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864898.447022:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864898.447032:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000946579a6/0xf8c13e2d0e9598dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc29 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.447044:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000946579a6/0xf8c13e2d0e9598dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc29 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.447092:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000946579a6/0xf8c13e2d0e9598dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc29 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864898.447136:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca0d5ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5820:1875760546645120:192.168.203.13@tcp:105: 00000100:00100000:1.0:1788864898.447239:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598d80 going to sleep for 11 seconds 00010000:00010000:3.0:1788864898.448105:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb790a9f/0xf8c13e2d0e9598d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc22 expref: 8 pid: 6684 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864898.448131:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0086300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1875760546644992:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788864898.448164:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000946579a6/0xf8c13e2d0e9598dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc29 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.448177:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4b600, rc 0) 00000100:00100000:3.0:1788864898.448232:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:10538:x1875760528801152:12345-192.168.203.13@tcp:101:bash.0 Request processed in 6605us (6867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864898.448242:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:0.0:1788864898.456808:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca0d5ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5820:1875760546645120:192.168.203.13@tcp:105: 00010000:00010000:0.0:1788864898.456863:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864898.456947:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2359:x1875760528801280:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 10037us (10451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864898.456960:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:3.0:1788864898.461199:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864898.461466:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528801536 00000100:00100000:2.0:1788864898.461487:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528801536 00000100:00100000:2.0:1788864898.461561:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:2.0:1788864898.461573:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+33:10538:x1875760528801536:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:2.0:1788864898.462402:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+34:10538:x1875760528801536:12345-192.168.203.13@tcp:35:bash.0 Request processed in 826us (1212us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788864898.462413:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00010000:00010000:1.0:1788864898.629285:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864898.654466:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864898.655658:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528801664 00000100:00100000:3.0:1788864898.655748:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528801664 00000100:00100000:3.0:1788864898.655842:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:3.0:1788864898.655855:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+34:10554:x1875760528801664:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788864898.655886:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864898.655914:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e9598e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fc30 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.656226:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e9598ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.656247:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e9598ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.656263:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e9598ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788864898.656318:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788864898.656323:0:6705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788864898.656347:0:6705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e9598ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.656376:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e9598e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc30 expref: 36 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.656402:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e9598ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc30 expref: 35 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.656431:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:3.0:1788864898.656434:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788864898.656439:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213f400, rc 0) 00000100:00100000:3.0:1788864898.656527:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+35:10554:x1875760528801664:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 673us (2070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864898.656535:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:1.0:1788864898.668550:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864898.668905:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528801920 00000100:00100000:2.0:1788864898.668921:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528801920 00000100:00100000:2.0:1788864898.669005:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:2.0:1788864898.669016:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca0d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+35:10554:x1875760528801920:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788864898.669037:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864898.669059:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e9598f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fc37 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.669155:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9598f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.669461:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9598f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.669474:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9598f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864898.669487:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788864898.669990:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e9598f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc37 expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.670011:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9598f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc37 expref: 37 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.670019:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e100) 00010000:00010000:2.0:1788864898.670021:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788864898.670025:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385c00, rc 0) 00000100:00100000:2.0:1788864898.670100:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca0d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+37:10554:x1875760528801920:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1085us (1564us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788864898.670121:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:0.0:1788864898.674385:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864898.675396:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528802176 00000100:00100000:3.0:1788864898.675413:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528802176 00000100:00100000:3.0:1788864898.675490:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:3.0:1788864898.675502:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+37:10554:x1875760528802176:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788864898.675534:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864898.675564:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e959906 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fc3e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.675936:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95990d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.675957:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95990d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.675984:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95990d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788864898.676083:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788864898.676249:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e959906 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc3e expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.676294:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95990d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc3e expref: 39 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.676303:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e100) 00010000:00010000:3.0:1788864898.676307:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788864898.676312:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213f600, rc 0) 00000100:00100000:3.0:1788864898.676397:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+39:10554:x1875760528802176:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 896us (2026us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788864898.676406:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:3.0:1788864898.677405:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864898.677479:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528802304 00000100:00100000:2.0:1788864898.677494:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528802304 00000100:00100000:2.0:1788864898.677576:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:2.0:1788864898.677586:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+39:2359:x1875760528802304:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788864898.677601:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864898.677634:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e9598f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc37 expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.677654:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e100) 00010000:00010000:2.0:1788864898.677659:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864898.677752:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+38:2359:x1875760528802304:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 167us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864898.677759:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:2.0:1788864898.683549:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864898.683697:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528802432 00000100:00100000:1.0:1788864898.683752:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528802432 00000100:00100000:1.0:1788864898.683825:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:1.0:1788864898.683915:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc062a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2358:x1875760528802432:12345-192.168.203.13@tcp:1:lfs.0 00010000:00010000:1.0:1788864898.684051:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1999677/0xf8c13e2d0e95991b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.684077:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000946579a6/0xf8c13e2d0e9598dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc29 expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.684087:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864898.684092:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788864898.684098:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1999677/0xf8c13e2d0e95991b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.684146:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000946579a6/0xf8c13e2d0e9598dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc29 expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.684163:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000946579a6/0xf8c13e2d0e9598dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc29 expref: 6 pid: 6685 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864898.684208:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca0d5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1875760546645248:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788864898.684954:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598840 going to sleep for 11 seconds 00000100:00100000:1.0:1788864898.687557:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca0d5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1875760546645248:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788864898.688066:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d1999677/0xf8c13e2d0e95991b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864898.694267:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864898.694559:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528802560 00000100:00100000:0.0:1788864898.694572:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528802560 00002000:00100000:0.0:1788864898.694656:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9fdcc062b800 x1875760528802560/t0(0) o4->1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp:374/0 lens 504/0 e 0 to 0 dl 1788864909 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788864898.694668:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fdcc062b800 with x1875760528802560 ext(0->8) 00010000:00010000:0.0:1788864898.694680:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000946579a6/0xf8c13e2d0e9598dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc29 expref: 7 pid: 6685 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864898.694741:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000946579a6/0xf8c13e2d0e9598dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc29 expref: 7 pid: 6685 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788864898.694752:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fdcc062b800 00000100:00100000:0.0:1788864898.694785:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:0.0:1788864898.694797:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc062b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2359:x1875760528802560:12345-192.168.203.13@tcp:4:lfs.0 00000100:00100000:0.0:1788864898.695455:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc062b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:2359:x1875760528802560:12345-192.168.203.13@tcp:4:lfs.0 Request processed in 656us (1198us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788864898.695466:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00002000:00100000:0.0:1788864898.695476:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9fdcc062b800 x1875760528802560/t4294967302(0) o4->1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp:374/0 lens 504/448 e 0 to 0 dl 1788864909 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788864898.695486:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fdcc062b800 with x1875760528802560 ext(0->8) 00010000:00010000:0.0:1788864898.695493:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000946579a6/0xf8c13e2d0e9598dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc29 expref: 9 pid: 6685 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864898.695568:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000946579a6/0xf8c13e2d0e9598dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc29 expref: 9 pid: 6685 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788864898.695578:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fdcc062b800 00000100:00100000:0.0:1788864898.702116:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864898.702188:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528802688 00000100:00100000:1.0:1788864898.702203:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528802688 00010000:00010000:1.0:1788864898.702271:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000946579a6/0xf8c13e2d0e9598dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc29 expref: 9 pid: 6685 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864898.702385:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:1.0:1788864898.702398:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0087480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:2359:x1875760528802688:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864898.702419:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788864898.702449:0:5820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788864898.702460:0:5820:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788864898 00002000:00010000:1.0:1788864898.702463:0:5820:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788864898 00002000:00010000:1.0:1788864898.702466:0:5820:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788864898 00010000:00010000:1.0:1788864898.702474:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000946579a6/0xf8c13e2d0e9598dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc29 expref: 9 pid: 6685 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.702491:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000946579a6/0xf8c13e2d0e9598dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc29 expref: 9 pid: 6685 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.702550:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000946579a6/0xf8c13e2d0e9598dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc29 expref: 9 pid: 6685 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.702574:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788864898.702579:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788864898.702596:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1999677/0xf8c13e2d0e95991b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.702610:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1999677/0xf8c13e2d0e95991b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.702651:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864898.702769:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0087480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2359:x1875760528802688:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 373us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864898.702777:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00010000:00010000:0.0:1788864898.702851:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d1999677/0xf8c13e2d0e95991b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864898.702861:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1999677/0xf8c13e2d0e95991b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864898.702891:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1999677/0xf8c13e2d0e95991b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864898.702900:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1999677/0xf8c13e2d0e95991b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864898.702910:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1999677/0xf8c13e2d0e95991b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864898.702918:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75800 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788864898.702923:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1999677/0xf8c13e2d0e95991b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864898.702933:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1999677/0xf8c13e2d0e95991b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864898.702946:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1999677/0xf8c13e2d0e95991b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864898.702955:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1999677/0xf8c13e2d0e95991b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864898.703164:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc062a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2358:x1875760528802432:12345-192.168.203.13@tcp:1:lfs.0 Request processed in 19254us (19630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864898.703175:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:0.0:1788864898.705054:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864898.705150:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528802944 00000100:00100000:3.0:1788864898.705164:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528802944 00000100:00100000:3.0:1788864898.705242:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:3.0:1788864898.705253:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca21f6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+38:10554:x1875760528802944:12345-192.168.203.13@tcp:35:lfs.0 00000004:00010000:3.0:1788864898.705344:0:5838:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95990d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc3e expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788864898.706331:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1788864898.706383:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1788864898.706891:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1788864898.706946:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959922 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.707101:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e9598c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc1b expref: 42 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.707112:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959922 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.707170:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e9598c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc1b expref: 42 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.707186:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e9598c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc1b expref: 42 pid: 5836 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864898.707203:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5838:1875760546645376:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788864898.707313:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc84e8f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788864898.715206:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5838:1875760546645376:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788864898.715250:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959922 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864898.717404:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864898.717509:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528803072 00000100:00100000:1.0:1788864898.717522:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528803072 00010000:00010000:1.0:1788864898.717582:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e9598c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc1b expref: 43 pid: 5836 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864898.717692:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:1.0:1788864898.717742:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+43:2359:x1875760528803072:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864898.717780:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864898.717788:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e9598c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc1b expref: 43 pid: 5836 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.717804:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e9598c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc1b expref: 43 pid: 5836 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.717831:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e9598c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc1b expref: 43 pid: 5836 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.717855:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e100) 00010000:00010000:1.0:1788864898.717872:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959922 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.717883:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959922 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.717892:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959922 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.717929:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864898.718065:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+42:2359:x1875760528803072:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 362us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864898.718073:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00010000:00010000:3.0:1788864898.718249:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959922 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.718260:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959922 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788864898.718445:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788864898.719517:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1788864898.720009:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5838:1875760546645504:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788864898.720153:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864898.720272:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc84e8fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788864898.720461:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546645504 00000100:00100000:1.0:1788864898.720473:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546645504 00000100:00100000:1.0:1788864898.720540:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788864898.720552:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1875760546645504:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788864898.720649:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1875760546645504:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 101us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864898.720669:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788864898.720838:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5838:1875760546645504:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788864898.722153:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1788864898.722273:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5838:1875760546645632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788864898.722345:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864898.722442:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc84e8f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788864898.722636:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546645632 00000100:00100000:1.0:1788864898.722644:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546645632 00000100:00100000:1.0:1788864898.723021:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788864898.723034:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1875760546645632:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788864898.723325:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5838:x1875760546645632:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 294us (980us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788864898.723333:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788864898.723412:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5838:1875760546645632:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788864898.723571:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1788864898.723627:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959922 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.723639:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959922 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.723648:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959922 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.723656:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213ea00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864898.723662:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959922 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.723837:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959922 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.723860:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e100) 00010000:00010000:3.0:1788864898.723864:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788864898.723870:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959922 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.723878:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959922 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788864898.724210:0:5838:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788864898.724328:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788864898.724342:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 321855637517ns, next at 322855634627ns, rc = 0 00000001:00080000:2.0:1788864898.724350:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788864898.724391:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e100) 00010000:00010000:2.0:1788864898.724394:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788864898.724403:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95990d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc3e expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864898.724606:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca21f6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+45:10554:x1875760528802944:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 19354us (19562us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1788864898.724630:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000020:00080000:2.0:1788864898.724637:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788864898.728127:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864898.728233:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528803200 00000100:00100000:1.0:1788864898.728247:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528803200 00000100:00100000:1.0:1788864898.728344:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:1.0:1788864898.728357:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+45:10554:x1875760528803200:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788864898.728389:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864898.728418:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959929 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fc45 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.728509:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959929 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc45 expref: 46 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.728527:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959929 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc45 expref: 46 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.728550:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:1.0:1788864898.728553:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788864898.728558:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc75000, rc 0) 00000100:00100000:1.0:1788864898.728677:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+46:10554:x1875760528803200:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 322us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864898.728700:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:0.0:1788864898.735143:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864898.735255:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528803456 00000100:00100000:1.0:1788864898.735428:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528803456 00000100:00100000:1.0:1788864898.735518:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:1.0:1788864898.735533:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+46:10554:x1875760528803456:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1788864898.740339:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+47:10554:x1875760528803456:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 4788us (5186us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1788864898.740361:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:2.0:1788864898.858769:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864898.858890:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528803584 00000100:00100000:3.0:1788864898.858913:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528803584 00000100:00100000:3.0:1788864898.858999:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:3.0:1788864898.859021:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+47:10564:x1875760528803584:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:3.0:1788864898.859121:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959930 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859162:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959930 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859178:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959930 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859197:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959937 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859204:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859211:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859321:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95993e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859329:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95993e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859336:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95993e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788864898.859385:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95993e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859400:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959930 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859407:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959930 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859427:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959930 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859433:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213ea00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864898.859438:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959930 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859446:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959930 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859460:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:3.0:1788864898.859463:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864898.859481:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959930 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859488:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959930 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859505:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859512:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959937 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859518:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859523:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213ec00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864898.859526:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859541:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959937 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859550:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fdc834b8a00) 00010000:00010000:3.0:1788864898.859552:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864898.859555:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959937 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859561:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959937 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859575:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95993e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859580:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95993e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859586:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95993e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859591:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213f600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864898.859593:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95993e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859599:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95993e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859605:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:3.0:1788864898.859607:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864898.859609:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95993e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.859624:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95993e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864898.859786:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+47:10564:x1875760528803584:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 766us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864898.859794:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:0.0:1788864898.886214:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788864898.886245:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546645760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788864898.886441:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864898.887419:0:10234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546645760 00000100:00100000:2.0:1788864898.887432:0:10234:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546645760 00000100:00100000:2.0:1788864898.887486:0:10234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788864898.887496:0:10234:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875760546645760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788864898.887528:0:10234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788864898.887603:0:10234:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875760546645760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864898.887611:0:10234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788864898.888401:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546645760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788864898.912810:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864898.912988:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528803840 00000100:00100000:2.0:1788864898.913001:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528803840 00000100:00100000:2.0:1788864898.913072:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 102 00000100:00100000:2.0:1788864898.913084:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+47:10567:x1875760528803840:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788864898.913111:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864898.913138:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959945 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fc4c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.913229:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e95994c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.913245:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e95994c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.913260:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e95994c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.913300:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959953 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.913308:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.913429:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.913582:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e95995a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.913591:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e95995a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.913599:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e95995a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864898.913610:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788864898.913759:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e95994c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.913768:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e95994c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.913775:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e95994c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.913781:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864898.913786:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e95994c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.913806:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e95994c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.913822:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:2.0:1788864898.913825:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864898.913831:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e95994c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.913838:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e95994c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.913853:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.913860:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959953 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.913866:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959953 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.913871:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864898.913874:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959953 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.913880:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959953 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.913888:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fdc9124ef00) 00010000:00010000:2.0:1788864898.913890:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864898.913893:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959953 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.913908:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959953 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.913960:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959945 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc4c expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.913986:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e95995a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc4c expref: 49 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864898.913994:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:2.0:1788864898.913998:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788864898.914001:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384800, rc 0) 00000100:00100000:2.0:1788864898.914128:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+49:10567:x1875760528803840:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1046us (1333us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788864898.914137:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 102 00000100:00100000:0.0:1788864898.921171:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864898.921547:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528803968 00000100:00100000:3.0:1788864898.921557:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528803968 00000100:00100000:3.0:1788864898.921645:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 103 00000100:00100000:3.0:1788864898.921656:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+49:10567:x1875760528803968:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:3.0:1788864898.921751:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959968 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.921768:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959968 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.921780:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959968 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.921815:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959968 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.921821:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959968 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.921829:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959968 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.921836:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213f600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864898.921852:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959968 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.921860:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959968 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.921871:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:3.0:1788864898.921874:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788864898.921878:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959968 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864898.921885:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959968 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864898.921980:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+49:10567:x1875760528803968:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 326us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864898.921988:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 103 00000100:00100000:0.0:1788864898.927091:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864898.927160:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528804224 00000100:00100000:3.0:1788864898.927173:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528804224 00000100:00100000:3.0:1788864898.927231:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:3.0:1788864898.927241:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+49:10567:x1875760528804224:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1788864898.927475:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+50:10567:x1875760528804224:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 235us (398us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788864898.927483:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:2.0:1788864898.994309:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864898.994428:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528804480 00000100:00100000:1.0:1788864898.994442:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528804480 00000100:00100000:1.0:1788864898.994528:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 104 00000100:00100000:1.0:1788864898.994541:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+50:10577:x1875760528804480:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788864898.994572:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864898.994576:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788864898.994610:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e9598ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc30 expref: 50 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.994633:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:1.0:1788864898.994639:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788864898.994655:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95996f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fc53 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.994852:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959976 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.994869:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e95995a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc4c expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.994897:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959976 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.994941:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e95995a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc4c expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864898.994958:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e95995a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc4c expref: 50 pid: 5835 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864898.994982:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca0d5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875760546645888:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788864898.995109:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598840 going to sleep for 11 seconds 00000100:00100000:1.0:1788864898.999071:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca0d5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875760546645888:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788864898.999118:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959976 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864899.000351:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864899.000936:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528804608 00000100:00100000:1.0:1788864899.000948:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528804608 00010000:00010000:1.0:1788864899.001026:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e95995a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc4c expref: 51 pid: 5835 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864899.001075:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:1.0:1788864899.001087:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+51:2359:x1875760528804608:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864899.001105:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864899.001113:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e95995a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc4c expref: 51 pid: 5835 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.001152:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e95995a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc4c expref: 51 pid: 5835 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.001181:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e95995a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc4c expref: 51 pid: 5835 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.001203:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:1.0:1788864899.001209:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959976 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.001220:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959976 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.001230:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959976 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.001271:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864899.001340:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+50:2359:x1875760528804608:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 255us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864899.001348:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00080000:3.0:1788864899.001588:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788864899.001904:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959976 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.001914:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959976 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864899.001938:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788864899.002144:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95996f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc53 expref: 51 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.002164:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959976 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc53 expref: 50 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.002173:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:0.0:1788864899.002176:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788864899.002191:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc75a00, rc 0) 00000100:00100000:0.0:1788864899.002241:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+50:10577:x1875760528804480:12345-192.168.203.13@tcp:101:bash.0 Request processed in 7703us (7948us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788864899.002250:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 104 00000100:00100000:2.0:1788864899.006018:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864899.006145:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528804864 00000100:00100000:1.0:1788864899.006158:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528804864 00000100:00100000:1.0:1788864899.006240:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 105 00000100:00100000:1.0:1788864899.006251:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+50:10577:x1875760528804864:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:1.0:1788864899.006634:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959984 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.006654:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959984 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.006678:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959984 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788864899.006994:0:6705:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1788864899.007025:0:6705:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f224d9bb reply state 00000000f3907340 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959984 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864899.007036:0:6705:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788864899.007194:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+53:10577:x1875760528804864:12345-192.168.203.13@tcp:36:bash.0 Request processed in 943us (1191us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1788864899.007203:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 105 00000020:00080000:1.0:1788864899.007209:0:6705:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788864899.011394:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864899.011501:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528804992 00000100:00100000:2.0:1788864899.011514:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528804992 00000100:00100000:2.0:1788864899.011588:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 106 00000100:00100000:2.0:1788864899.011600:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+53:10577:x1875760528804992:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1788864899.011631:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864899.011658:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95998b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fc5a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.011800:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959992 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.011945:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959976 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc53 expref: 54 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.011955:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959984 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.011971:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959992 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.011995:0:5835:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959984 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.012027:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959976 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc53 expref: 54 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.012043:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959976 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc53 expref: 54 pid: 5836 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864899.012059:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86ebb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875760546646016:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788864899.012164:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc91375540 going to sleep for 11 seconds 00010000:00010000:1.0:1788864899.015745:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959984 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.015769:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959984 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.015777:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959984 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.015784:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864899.015791:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959984 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.015800:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959984 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.015822:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:1.0:1788864899.015837:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864899.015860:0:3287:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959992 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.015875:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959984 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.015882:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959984 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864899.016300:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864899.016373:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528805120 00000100:00100000:1.0:1788864899.016385:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528805120 00010000:00010000:1.0:1788864899.016428:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959976 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc53 expref: 54 pid: 5836 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864899.016475:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:1.0:1788864899.016486:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0084a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+54:2358:x1875760528805120:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864899.016503:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864899.016511:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959976 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc53 expref: 54 pid: 5836 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.016525:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959976 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc53 expref: 54 pid: 5836 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.016543:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:1.0:1788864899.016547:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959992 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.016557:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.016566:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959992 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.016597:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864899.016668:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0084a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+54:2358:x1875760528805120:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 182us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864899.016676:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00010000:00010000:2.0:1788864899.018516:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959976 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc53 expref: 53 pid: 5836 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864899.018549:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86ebb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875760546646016:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788864899.018581:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.018594:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.018620:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864899.018688:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788864899.018694:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788864899.018749:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.018795:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95998b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc5a expref: 53 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.018814:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959992 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc5a expref: 52 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.018836:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:2.0:1788864899.018840:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788864899.018846:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384e00, rc 0) 00000100:00100000:2.0:1788864899.018922:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+52:10577:x1875760528804992:12345-192.168.203.13@tcp:101:bash.0 Request processed in 7324us (7542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864899.018931:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 106 00000100:00100000:0.0:1788864899.023039:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864899.023136:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528805376 00000100:00100000:1.0:1788864899.023149:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528805376 00000100:00100000:1.0:1788864899.023209:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:1.0:1788864899.023220:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+52:10577:x1875760528805376:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:1.0:1788864899.023523:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+53:10577:x1875760528805376:12345-192.168.203.13@tcp:35:bash.0 Request processed in 303us (499us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788864899.023531:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:0.0:1788864899.075199:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864899.075343:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528805504 00000100:00100000:3.0:1788864899.075359:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528805504 00000100:00100000:3.0:1788864899.075451:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 107 00000100:00100000:3.0:1788864899.075464:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+53:10583:x1875760528805504:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788864899.075518:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864899.075545:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959999 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fc61 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.075627:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e9599a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.075645:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e9599a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.075659:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e9599a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788864899.075743:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788864899.075748:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788864899.075771:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e9599a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.075801:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959999 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc61 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.075823:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e9599a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc61 expref: 54 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.075832:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:3.0:1788864899.075835:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788864899.075840:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213e400, rc 0) 00000100:00100000:3.0:1788864899.075905:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+54:10583:x1875760528805504:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 444us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864899.075913:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 107 00000100:00100000:0.0:1788864899.082787:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864899.083064:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528805632 00000100:00100000:1.0:1788864899.083079:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528805632 00000100:00100000:1.0:1788864899.083216:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:1.0:1788864899.083229:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+54:10583:x1875760528805632:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788864899.083257:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864899.083285:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9599a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fc68 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083371:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e9599ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083389:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e9599ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083403:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e9599ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083446:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9599b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083455:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9599b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083463:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9599b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083588:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e9599bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083599:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e9599bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083606:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e9599bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864899.083651:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788864899.083656:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788864899.083677:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e9599bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083690:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e9599bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083698:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e9599ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083746:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e9599ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083763:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e9599ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083770:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864899.083775:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e9599ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083785:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e9599ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083799:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:1.0:1788864899.083803:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864899.083808:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e9599ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083816:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e9599ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083834:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9599b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083840:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9599b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083846:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9599b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083851:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864899.083854:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9599b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083870:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9599b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083879:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fdc8328e200) 00010000:00010000:1.0:1788864899.083882:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864899.083885:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9599b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083890:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9599b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083927:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9599a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc68 expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083943:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e9599bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc68 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.083961:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:1.0:1788864899.083972:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788864899.083975:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc75400, rc 0) 00000100:00100000:1.0:1788864899.084045:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+55:10583:x1875760528805632:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 819us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864899.084054:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:0.0:1788864899.094164:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864899.094227:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864899.094264:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528805888 00000100:00100000:3.0:1788864899.094277:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528805888 00000100:00100000:2.0:1788864899.094378:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528806016 00000100:00100000:2.0:1788864899.094383:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528806016 00000100:00100000:3.0:1788864899.094394:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 109 00000100:00100000:3.0:1788864899.094405:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+56:10583:x1875760528805888:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788864899.094428:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864899.094466:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9599c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fc6f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864899.094474:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1788864899.094482:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0086300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+57:2358:x1875760528806016:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788864899.094498:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864899.094522:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e9599bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc68 expref: 57 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.094564:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:2.0:1788864899.094570:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788864899.094590:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9599ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.094605:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959992 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc5a expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.094613:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9599ca lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864899.094634:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0086300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+56:2358:x1875760528806016:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 153us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864899.094641:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00010000:00010000:3.0:1788864899.094652:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959992 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc5a expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.094673:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959992 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc5a expref: 55 pid: 5835 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864899.094688:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875760546646144:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788864899.094796:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc84e8f480 going to sleep for 11 seconds 00000100:00100000:0.0:1788864899.099387:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864899.099579:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528806144 00000100:00100000:1.0:1788864899.099592:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528806144 00010000:00010000:1.0:1788864899.099650:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959992 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc5a expref: 56 pid: 5835 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864899.099795:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875760546646144:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788864899.099821:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00010000:00010000:3.0:1788864899.099826:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9599ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864899.099843:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1e52850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+56:2358:x1875760528806144:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864899.099862:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864899.099871:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959992 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc5a expref: 56 pid: 5835 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.099885:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959992 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc5a expref: 56 pid: 5835 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.099910:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e959992 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc5a expref: 56 pid: 5835 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.099929:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:1.0:1788864899.099934:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9599ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.099945:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9599ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.099954:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9599ca lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.099989:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864899.100062:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1e52850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+55:2358:x1875760528806144:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 219us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864899.100070:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00010000:00010000:3.0:1788864899.100577:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9599ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.100588:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9599ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788864899.100612:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788864899.100834:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e9599c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc6f expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.100854:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9599ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc6f expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.100861:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:3.0:1788864899.100864:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788864899.100867:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213f800, rc 0) 00000100:00100000:3.0:1788864899.101694:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+55:10583:x1875760528805888:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 7284us (7539us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1788864899.101959:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 109 00000100:00100000:0.0:1788864899.105179:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864899.105304:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528806400 00000100:00100000:2.0:1788864899.105316:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528806400 00000100:00100000:2.0:1788864899.105428:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:2.0:1788864899.105440:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0087480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+55:10583:x1875760528806400:12345-192.168.203.13@tcp:103:lfs.0 00010000:00010000:2.0:1788864899.105460:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864899.105555:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959929 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc45 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.105578:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:2.0:1788864899.105584:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864899.105690:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0087480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+54:10583:x1875760528806400:12345-192.168.203.13@tcp:103:lfs.0 Request processed in 252us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864899.105699:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:2.0:1788864899.108329:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864899.108419:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528806528 00000100:00100000:1.0:1788864899.108453:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528806528 00000100:00100000:1.0:1788864899.108539:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 110 00000100:00100000:1.0:1788864899.108552:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+54:10583:x1875760528806528:12345-192.168.203.13@tcp:58:lfs.0 00010000:00010000:1.0:1788864899.108734:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9599d8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.108755:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9599d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.108770:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9599d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788864899.109063:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788864899.109177:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+54:10583:x1875760528806528:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 626us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864899.109187:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 110 00000100:00100000:2.0:1788864899.111812:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864899.112095:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528806656 00000100:00100000:1.0:1788864899.112108:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528806656 00000100:00100000:1.0:1788864899.112184:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 111 00000100:00100000:1.0:1788864899.112197:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+54:10583:x1875760528806656:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788864899.112226:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864899.112258:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9599df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fc76 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.112334:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9599d8 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.112347:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9599df lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc76 expref: 55 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.112395:0:6705:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9599d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.112412:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9599df lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc76 expref: 55 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.112428:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:1.0:1788864899.112431:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788864899.112436:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9599df lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc76 expref: 55 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.112444:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc74600, rc 0) 00000100:00100000:1.0:1788864899.112842:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+55:10583:x1875760528806656:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 646us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864899.112851:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 111 00000040:00080000:1.0:1788864899.463249:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788864899.463261:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788864899.463305:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788864899.463312:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788864899.463499:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca0d5ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1875760546646272:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788864899.463637:0:11671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864899.468947:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca0d5ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1875760546646272:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788864899.473187:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864899.474357:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528806784 00000100:00100000:1.0:1788864899.474373:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528806784 00000100:00100000:1.0:1788864899.474563:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 112 00000100:00100000:1.0:1788864899.474576:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+55:10584:x1875760528806784:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788864899.474636:0:5835:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788864899.474807:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+55:10584:x1875760528806784:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 234us (1633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864899.474816:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 112 00000100:00100000:2.0:1788864899.483969:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864899.484109:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528806912 00000100:00100000:0.0:1788864899.484124:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528806912 00000100:00100000:0.0:1788864899.484203:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:0.0:1788864899.484216:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+55:10584:x1875760528806912:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788864899.484320:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e9599e6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484341:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e9599e6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484357:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e9599e6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484554:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e9599ed lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484580:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e9599ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484613:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e9599ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484646:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e9599f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484656:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e9599f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484663:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e9599f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864899.484743:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788864899.484748:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788864899.484761:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e9599f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484772:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e9599e6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484779:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e9599e6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484785:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e9599e6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484792:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4b400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864899.484796:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e9599e6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484804:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e9599e6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484826:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fdca4f57c00) 00010000:00010000:0.0:1788864899.484829:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864899.484834:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e9599e6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484840:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e9599e6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484858:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e9599ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484865:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e9599ed lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484870:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e9599ed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484875:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4b800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864899.484877:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e9599ed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484883:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e9599ed lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484890:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9fdca4f57a00) 00010000:00010000:0.0:1788864899.484892:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864899.484895:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e9599ed lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484902:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b800/0xf8c13e2d0e9599ed lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484930:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e9599f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484943:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e9599f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484950:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e9599f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484955:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4ac00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864899.484959:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e9599f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484975:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e9599f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484984:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:0.0:1788864899.484987:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864899.484991:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e9599f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.484998:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e9599f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864899.485097:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+55:10584:x1875760528806912:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 880us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864899.485108:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:3.0:1788864899.490871:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864899.490956:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528807168 00000100:00100000:0.0:1788864899.490982:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528807168 00000100:00100000:0.0:1788864899.491045:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:0.0:1788864899.491069:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+55:10584:x1875760528807168:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788864899.491089:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864899.491109:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9599fb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fc7d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.491206:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959a02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.491222:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959a02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.491233:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959a02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864899.491244:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788864899.491340:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959a02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.491347:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959a02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.491354:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959a02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.491360:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4ba00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864899.491364:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959a02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.491371:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959a02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.491382:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:0.0:1788864899.491392:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788864899.491397:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959a02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.491403:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959a02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.491443:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9599fb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc7d expref: 57 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.491450:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fdca4f57c00) 00010000:00010000:0.0:1788864899.491451:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788864899.491454:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e9599fb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc7d expref: 57 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.491460:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4b000, rc 0) 00000100:00100000:0.0:1788864899.491520:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+56:10584:x1875760528807168:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 454us (664us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1788864899.491526:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:2.0:1788864899.500144:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864899.500225:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528807296 00000100:00100000:1.0:1788864899.500235:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528807296 00000100:00100000:1.0:1788864899.500290:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:1.0:1788864899.500300:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+56:10584:x1875760528807296:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788864899.500334:0:6705:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788864899.500429:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+56:10584:x1875760528807296:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 130us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864899.500437:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:2.0:1788864899.511492:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864899.511584:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528807552 00000100:00100000:1.0:1788864899.511593:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528807552 00000100:00100000:1.0:1788864899.511651:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:1.0:1788864899.511661:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+56:10584:x1875760528807552:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788864899.511679:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864899.511682:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788864899.511738:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e9599a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc61 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.511758:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:1.0:1788864899.511762:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788864899.511775:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a10 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fc84 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788864899.512634:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788864899.512889:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959a17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.512904:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959a17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.512914:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959a17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.514380:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a10 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc84 expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.514408:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959a17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc84 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.514417:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:1.0:1788864899.514420:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788864899.514424:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc75600, rc 0) 00000100:00100000:1.0:1788864899.514503:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+57:10584:x1875760528807552:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 2842us (3019us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788864899.514511:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:3.0:1788864899.522176:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864899.522753:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528807808 00000100:00100000:1.0:1788864899.522764:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528807808 00000100:00100000:1.0:1788864899.522831:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:1.0:1788864899.522842:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+57:10584:x1875760528807808:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788864899.522897:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864899.522933:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959a17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc84 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.522967:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:1.0:1788864899.522978:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788864899.522998:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a25 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.523011:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.523021:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.523037:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959a2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x2d3dac5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.523045:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959a2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2d3dac5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.523051:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959a2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2d3dac5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.523110:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.523118:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a25 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.523125:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a25 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.523131:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864899.523141:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a25 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.523148:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a25 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.523157:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:1.0:1788864899.523160:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864899.523164:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a25 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.523170:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a25 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.523180:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959a2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2d3dac5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.523186:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959a2c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2d3dac5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.523192:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959a2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2d3dac5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.523197:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864899.523200:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959a2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2d3dac5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.523206:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959a2c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2d3dac5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.523213:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x2d3dac5c (ffff9fdc8328e100) 00010000:00010000:1.0:1788864899.523216:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864899.523227:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959a2c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2d3dac5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.523233:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959a2c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2d3dac5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864899.523421:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+56:10584:x1875760528807808:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 580us (1253us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788864899.523429:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:2.0:1788864899.527326:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864899.527455:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528807936 00000100:00100000:0.0:1788864899.527474:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528807936 00000100:00100000:0.0:1788864899.527528:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:0.0:1788864899.527538:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+56:10584:x1875760528807936:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788864899.527556:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864899.527577:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959a33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fc8b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.527609:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959a3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.527630:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959a3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.527641:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959a3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.527765:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959a33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc8b expref: 58 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.527784:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959a3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc8b expref: 57 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.527793:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fdca4f57a00) 00010000:00010000:0.0:1788864899.527796:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788864899.527799:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4ba00, rc 0) 00000100:00100000:0.0:1788864899.527867:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+57:10584:x1875760528807936:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 330us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864899.527874:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:2.0:1788864899.534566:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864899.534738:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528808192 00000100:00100000:1.0:1788864899.534749:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528808192 00000100:00100000:1.0:1788864899.534804:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:1.0:1788864899.534816:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+57:10584:x1875760528808192:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788864899.534903:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959a41 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.534919:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959a41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.534931:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959a41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788864899.535186:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1788864899.535196:0:6705:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 322666491198ns, next at 323666488791ns, rc = 0 00000004:00010000:1.0:1788864899.535369:0:6705:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a7359e4 reply state 000000001cb60851 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959a41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864899.535379:0:6705:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788864899.535662:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+59:10584:x1875760528808192:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 847us (1102us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1788864899.535686:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 119 00010000:00010000:2.0:1788864899.538341:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959a41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.538360:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959a41 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.538368:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959a41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.538374:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864899.538378:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959a41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.538386:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959a41 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.538402:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fdca4f57a00) 00010000:00010000:2.0:1788864899.538405:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788864899.538410:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959a41 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.538416:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959a41 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864899.540660:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864899.540953:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528808320 00000100:00100000:0.0:1788864899.540972:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528808320 00000100:00100000:0.0:1788864899.541028:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:0.0:1788864899.541040:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+58:10584:x1875760528808320:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788864899.541061:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864899.541079:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959a48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fc92 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.541136:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959a48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc92 expref: 59 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.541165:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959a48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc92 expref: 59 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.541186:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fdca4f57a00) 00010000:00010000:0.0:1788864899.541190:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788864899.541194:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4b000, rc 0) 00000100:00100000:0.0:1788864899.541384:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+59:10584:x1875760528808320:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 345us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864899.541392:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:1.0:1788864899.550282:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864899.550454:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528808448 00000100:00100000:3.0:1788864899.550465:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528808448 00000100:00100000:3.0:1788864899.550531:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:3.0:1788864899.550541:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca0d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2358:x1875760528808448:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788864899.551202:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca0d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:2358:x1875760528808448:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 660us (927us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788864899.551226:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:2.0:1788864899.558809:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864899.558977:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528808704 00000100:00100000:1.0:1788864899.558986:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528808704 00000100:00100000:1.0:1788864899.559036:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:1.0:1788864899.559045:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+59:10584:x1875760528808704:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788864899.560224:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+60:10584:x1875760528808704:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 1175us (1418us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788864899.560235:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:2.0:1788864899.562184:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864899.562276:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528808960 00000100:00100000:0.0:1788864899.562286:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528808960 00000100:00100000:0.0:1788864899.562338:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:0.0:1788864899.562348:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+60:10584:x1875760528808960:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788864899.562450:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+60:10584:x1875760528808960:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 102us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864899.562458:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:0.0:1788864899.567523:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864899.567649:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528809088 00000100:00100000:1.0:1788864899.567660:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528809088 00000100:00100000:1.0:1788864899.567746:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:1.0:1788864899.567757:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+60:10584:x1875760528809088:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788864899.567776:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864899.567795:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fc99 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.567871:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959a56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.567884:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959a56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.567894:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959a56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864899.567925:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788864899.567976:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959a56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.568002:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc99 expref: 62 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.568019:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959a56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc99 expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.568028:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fdca4f57a00) 00010000:00010000:1.0:1788864899.568032:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788864899.568035:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc75600, rc 0) 00000100:00100000:1.0:1788864899.568086:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+61:10584:x1875760528809088:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 331us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864899.568093:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:2.0:1788864899.573431:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864899.573575:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528809216 00000100:00100000:3.0:1788864899.573584:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528809216 00000100:00100000:3.0:1788864899.573643:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:3.0:1788864899.573652:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:2359:x1875760528809216:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788864899.573669:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864899.573689:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009975d5b4/0xf8c13e2d0e959a5d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fca0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788864899.573752:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fe983, blocks: 0x1 00010000:00010000:3.0:1788864899.573774:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=322s v=(0 0) 00010000:00010000:3.0:1788864899.573778:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788864899.573787:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009975d5b4/0xf8c13e2d0e959a5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fca0 expref: 10 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.573806:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009975d5b4/0xf8c13e2d0e959a5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fca0 expref: 10 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.573818:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213f400, rc 0) 00000100:00100000:3.0:1788864899.573881:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+10:2359:x1875760528809216:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 230us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864899.573889:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:2.0:1788864899.578918:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864899.579149:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528809472 00000100:00100000:0.0:1788864899.579159:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528809472 00000100:00100000:0.0:1788864899.579215:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:0.0:1788864899.579224:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+61:10584:x1875760528809472:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788864899.579344:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+61:10584:x1875760528809472:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 118us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864899.579351:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:1.0:1788864899.584087:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864899.584231:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528809600 00000100:00100000:0.0:1788864899.584241:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528809600 00000100:00100000:0.0:1788864899.584307:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:0.0:1788864899.584317:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca0d5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+10:10584:x1875760528809600:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788864899.584335:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864899.584353:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e959a64 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fca7 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.584385:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009975d5b4/0xf8c13e2d0e959a5d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fca0 expref: 11 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.584394:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788864899.584397:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788864899.584403:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e959a64 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fca7 expref: 11 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.584436:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009975d5b4/0xf8c13e2d0e959a5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fca0 expref: 11 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.584449:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009975d5b4/0xf8c13e2d0e959a5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fca0 expref: 11 pid: 6684 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864899.584462:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0086300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1875760546646400:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788864899.584557:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca8d28c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788864899.589855:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864899.589927:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528809728 00000100:00100000:1.0:1788864899.589936:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528809728 00010000:00010000:1.0:1788864899.589995:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009975d5b4/0xf8c13e2d0e959a5d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fca0 expref: 12 pid: 6684 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864899.590039:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:1.0:1788864899.590049:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc827100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+12:2359:x1875760528809728:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864899.590064:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864899.590087:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009975d5b4/0xf8c13e2d0e959a5d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fca0 expref: 12 pid: 6684 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.590101:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009975d5b4/0xf8c13e2d0e959a5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fca0 expref: 12 pid: 6684 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.590138:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864899.590142:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864899.590149:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e959a64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fca7 expref: 12 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.590159:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e959a64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fca7 expref: 12 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.590196:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e959a64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fca7 expref: 12 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864899.590211:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca0d5f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5820:1875760546646528:192.168.203.13@tcp:105: 00000100:00100000:1.0:1788864899.590310:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598300 going to sleep for 11 seconds 00010000:00010000:0.0:1788864899.591104:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009975d5b4/0xf8c13e2d0e959a5d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fca0 expref: 12 pid: 6684 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864899.591137:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0086300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1875760546646400:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788864899.591163:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e959a64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fca7 expref: 11 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.591176:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4b800, rc 0) 00000100:00100000:0.0:1788864899.591224:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca0d5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+11:10584:x1875760528809600:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 6907us (7145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864899.591231:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:2.0:1788864899.597879:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864899.598011:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca0d5f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5820:1875760546646528:192.168.203.13@tcp:105: 00010000:00010000:0.0:1788864899.598036:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864899.598092:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc827100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+10:2359:x1875760528809728:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 8044us (8245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864899.598103:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:3.0:1788864899.598264:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528809856 00000100:00100000:3.0:1788864899.598272:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528809856 00002000:00100000:3.0:1788864899.598312:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9fdcbc826d80 x1875760528809856/t0(0) o4->1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp:375/0 lens 504/0 e 0 to 0 dl 1788864910 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788864899.598333:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fdcbc826d80 with x1875760528809856 ext(0->12) 00002000:00010000:3.0:1788864899.598338:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fdcbc826d80 00000100:00100000:3.0:1788864899.598369:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:3.0:1788864899.598377:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+10:2359:x1875760528809856:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788864899.598804:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+12:2359:x1875760528809856:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 Request processed in 426us (931us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788864899.598812:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00002000:00100000:3.0:1788864899.598819:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9fdcbc826d80 x1875760528809856/t4294967308(0) o4->1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp:375/0 lens 504/448 e 0 to 0 dl 1788864910 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788864899.598827:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fdcbc826d80 with x1875760528809856 ext(0->12) 00002000:00010000:3.0:1788864899.598830:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fdcbc826d80 00000100:00100000:2.0:1788864899.601890:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864899.601990:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528809984 00000100:00100000:1.0:1788864899.602002:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528809984 00000100:00100000:1.0:1788864899.602065:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:1.0:1788864899.602076:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+61:10584:x1875760528809984:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00010000:00010000:2.0:1788864899.653668:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788864899.677125:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000020:00080000:1.0:1788864899.677167:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fdc85e0b840 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788864899.677174:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fdc90e09500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fdc85e0bcc0 00000020:00080000:1.0:1788864899.677178:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fdc90e09f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fdcac5fb400 00000001:00080000:1.0:1788864899.677205:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1788864899.677214:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:1.0:1788864899.677249:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788864899.677288:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:1.0:1788864899.677310:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788864899.677350:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fdc84e8fd80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788864899.677354:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fdcc00b6d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fdc84e8f000 00000020:00080000:1.0:1788864899.677358:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fdcc00b6300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fdcc051b400 00000100:00100000:3.0:1788864899.678018:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+15:10584:x1875760528809984:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 75935us (76127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864899.678030:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:0.0:1788864899.678812:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca0d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546646656:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788864899.678893:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864899.678976:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788864899.678983:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca0d5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546646784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788864899.679008:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864899.679042:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546646656 00000020:00080000:2.0:1788864899.679141:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788864899.679368:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788864899.679620:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca0d5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546646912:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788864899.679658:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864899.679695:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546646784 00000100:00100000:0.0:1788864899.679842:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546646656 00000100:00100000:0.0:1788864899.679896:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546646912 00000100:00100000:0.0:1788864899.679901:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546646912 00000100:00100000:0.0:1788864899.679919:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788864899.679928:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1875760546646656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788864899.679996:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1788864899.680032:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e959a6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864899.680164:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788864899.680175:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca0d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1875760546646912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788864899.680189:0:6684:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1788864899.680222:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9fe982, atime: 0x6a9fe982, ctime: 0x6a9fe982, blocks: 0x1 00010000:00010000:3.0:1788864899.680229:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd6d962b/0xf8c13e2d0e959a72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.680242:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=322s v=(0 0) 00010000:00010000:3.0:1788864899.680248:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788864899.680263:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6d962b/0xf8c13e2d0e959a72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.680284:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd6d962b/0xf8c13e2d0e959a72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.680295:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd6d962b/0xf8c13e2d0e959a72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.680303:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6d962b/0xf8c13e2d0e959a72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.680325:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788864899.681121:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546646784 00010000:00010000:0.0:1788864899.682323:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e95982d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc06 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.682342:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788864899.682347:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788864899.682354:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e959a6b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.682437:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e95982d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc06 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.682458:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e95982d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc06 expref: 11 pid: 6682 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.682674:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864899.682684:0:11155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd6d962b/0xf8c13e2d0e959a72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.682695:0:11155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213ea00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:2.0:1788864899.682701:0:11155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd6d962b/0xf8c13e2d0e959a72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864899.683360:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca0d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1875760546646912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3184us (3697us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788864899.683371:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788864899.683405:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788864899.683416:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc063aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3300:x1875760546646784:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1788864899.683625:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fdca0d5c380/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788864899.683634:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca0d5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546646912:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788864899.683792:0:11155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd6d962b/0xf8c13e2d0e959a72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.683817:0:11155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd6d962b/0xf8c13e2d0e959a72 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.683825:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd6d962b/0xf8c13e2d0e959a72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.683852:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864899.683854:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864899.683856:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864899.683923:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9080ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6682:1875760546647040:192.168.203.13@tcp:104: 00002000:00010000:3.0:1788864899.684576:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788864899.684581:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788864899 00002000:00010000:3.0:1788864899.684584:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788864899.684587:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788864899 -> 1788864899 00002000:00010000:3.0:1788864899.684589:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788864899.684644:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc063aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3300:x1875760546646784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1231us (5634us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788864899.684653:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:1.0:1788864899.685238:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fdca0d5d180/2, rc 0, transno 4294967309 00000100:00100000:1.0:1788864899.685248:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca0d5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546646784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788864899.686393:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca8d28c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788864899.687689:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864899.690539:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528810112 00000100:00100000:1.0:1788864899.690559:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528810112 00000100:00100000:1.0:1788864899.690640:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:1.0:1788864899.690652:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+12:2358:x1875760528810112:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788864899.691245:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864899.691277:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528810240 00000100:00100000:2.0:1788864899.691282:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528810240 00010000:00010000:2.0:1788864899.691310:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e95982d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc06 expref: 13 pid: 6682 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864899.691359:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:2.0:1788864899.691367:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0360700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+13:2358:x1875760528810240:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788864899.691380:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864899.691387:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e95982d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc06 expref: 13 pid: 6682 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.691406:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e95982d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc06 expref: 13 pid: 6682 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.691439:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788864899.691445:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788864899.691452:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e959a6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.691464:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e959a6b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.691490:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864899.691717:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0360700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+13:2358:x1875760528810240:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 333us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864899.691727:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00010000:00010000:1.0:1788864899.695003:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e95982d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc06 expref: 12 pid: 6682 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864899.695031:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9080ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6682:1875760546647040:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788864899.695678:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e959a6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.695696:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e959a6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.695933:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e959a6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.695946:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e959a6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.695954:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e959a6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.695986:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788864899.697575:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3300:x1875760546646656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17639us (18674us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788864899.697589:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1788864899.697755:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864899.697765:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e959a6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.697779:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4b400 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788864899.697784:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e959a6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.697807:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e959a6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.697831:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e959a6b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.697839:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e959a6b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.697864:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864899.697866:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864899.697868:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788864899.700178:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fdca0d5ca80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788864899.700200:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca0d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546646656:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788864899.741250:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+11:2358:x1875760528810112:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 50580us (53548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864899.741289:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000001:00080000:1.0:1788864899.741536:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1788864899.741552:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1788864899.741562:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:1.0:1788864899.741572:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1788864899.741578:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1788864899.750087:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864899.750842:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528810496 00000100:00100000:0.0:1788864899.750857:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528810496 00000100:00100000:0.0:1788864899.750938:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:0.0:1788864899.750951:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+15:10584:x1875760528810496:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788864899.751035:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864899.751083:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959a56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc99 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.751109:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fdca4f57a00) 00010000:00010000:0.0:1788864899.751115:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788864899.751156:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959a79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.751173:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959a79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.751205:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959a79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788864899.751525:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b6edaa8 reply state 000000007da95c08 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959a79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864899.751537:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788864899.751675:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+16:10584:x1875760528810496:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 725us (1601us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788864899.751684:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:3.0:1788864899.761307:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864899.761387:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528810624 00000100:00100000:0.0:1788864899.761401:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528810624 00000100:00100000:0.0:1788864899.761481:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:0.0:1788864899.761495:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2359:x1875760528810624:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788864899.761890:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788864899.761895:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788864899 -> 1788864898 00002000:00010000:0.0:1788864899.761898:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788864898 00002000:00010000:0.0:1788864899.761901:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788864899 -> 1788864898 00002000:00010000:0.0:1788864899.761904:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788864899.761981:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2359:x1875760528810624:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 490us (689us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788864899.761990:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00010000:00010000:1.0:1788864899.762244:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959a79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.762257:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959a79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.762267:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959a79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.762273:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4b400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864899.762297:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959a79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.762307:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959a79 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.762329:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fdca4f57a00) 00010000:00010000:1.0:1788864899.762332:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864899.762338:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959a79 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.762346:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959a79 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864899.768041:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864899.772422:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528810880 00000100:00100000:0.0:1788864899.772444:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528810880 00000100:00100000:0.0:1788864899.772559:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 126 00000100:00100000:0.0:1788864899.772572:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+15:10584:x1875760528810880:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788864899.772693:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e959a80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.772782:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959a3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc8b expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.772793:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e959a80 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.772840:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959a3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc8b expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.772855:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959a3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc8b expref: 15 pid: 5836 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864899.772872:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9080ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875760546647168:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788864899.773014:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfdbea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788864899.776270:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9080ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875760546647168:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788864899.776308:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e959a80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864899.778336:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864899.778766:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528811008 00000100:00100000:0.0:1788864899.778778:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528811008 00010000:00010000:0.0:1788864899.778830:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959a3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc8b expref: 16 pid: 5836 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864899.778880:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:0.0:1788864899.778891:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+16:2358:x1875760528811008:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788864899.778929:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864899.778939:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959a3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc8b expref: 16 pid: 5836 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.778955:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959a3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc8b expref: 16 pid: 5836 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.778995:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e959a3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc8b expref: 16 pid: 5836 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.779017:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fdca4f57a00) 00010000:00010000:0.0:1788864899.779023:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e959a80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.779034:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e959a80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.779043:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e959a80 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.779358:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864899.779428:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+15:2358:x1875760528811008:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 538us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864899.779437:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00010000:00010000:1.0:1788864899.782334:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e959a80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.782357:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e959a80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.782402:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e959a80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.782410:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e959a80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.782418:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e959a80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.782424:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864899.782429:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e959a80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.782538:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e959a80 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.782562:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fdca4f57a00) 00010000:00010000:1.0:1788864899.782565:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788864899.782571:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e959a80 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.782577:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e959a80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864899.782979:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+14:10584:x1875760528810880:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 Request processed in 10402us (14946us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788864899.782992:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 126 00000100:00100000:3.0:1788864899.789606:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864899.789922:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528811136 00000100:00100000:1.0:1788864899.789937:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528811136 00000100:00100000:1.0:1788864899.790080:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:1.0:1788864899.790094:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2359:x1875760528811136:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788864899.790159:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959a87 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.790184:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e959a64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fca7 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.790195:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864899.790201:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788864899.790207:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959a87 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.790277:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e959a64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fca7 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.790293:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e959a64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fca7 expref: 7 pid: 6685 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864899.790311:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca0d5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6682:1875760546647296:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788864899.790460:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc91375540 going to sleep for 11 seconds 00000100:00100000:2.0:1788864899.794888:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864899.795025:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528811264 00000100:00100000:3.0:1788864899.795035:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528811264 00000100:00100000:1.0:1788864899.795038:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca0d5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6682:1875760546647296:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788864899.795076:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959a87 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.795229:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e959a64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fca7 expref: 8 pid: 6685 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864899.795307:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:3.0:1788864899.795318:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0360e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2359:x1875760528811264:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788864899.795338:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864899.795368:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e959a64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fca7 expref: 8 pid: 6685 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.795382:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e959a64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fca7 expref: 8 pid: 6685 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.795408:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e959a64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fca7 expref: 8 pid: 6685 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.795425:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788864899.795429:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788864899.795435:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959a87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.795446:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959a87 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.795564:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788864899.795590:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959a87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.795600:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959a87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.795630:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959a87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864899.795633:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0360e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2359:x1875760528811264:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 317us (759us total) trans 0 rc 0/0 00010000:00010000:1.0:1788864899.795640:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959a87 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864899.795641:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00010000:00010000:1.0:1788864899.795660:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959a87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.795668:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75200 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788864899.795673:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959a87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.795683:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959a87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.795695:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959a87 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.795725:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959a87 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864899.795777:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2359:x1875760528811136:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 5688us (6187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864899.795785:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:3.0:1788864899.798244:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864899.798633:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528811520 00000100:00100000:1.0:1788864899.798646:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528811520 00000100:00100000:1.0:1788864899.798852:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00100000:1.0:1788864899.798866:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+14:10584:x1875760528811520:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788864899.798984:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959a8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.799024:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959a8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.799041:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959a8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.799398:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a95 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.799412:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959a48 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc92 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.799421:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a95 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.799739:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959a48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc92 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.799771:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959a48 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc92 expref: 15 pid: 5836 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864899.799790:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca0d5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6705:1875760546647424:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788864899.800044:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc91375540 going to sleep for 11 seconds 00000100:00100000:2.0:1788864899.804371:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca0d5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6705:1875760546647424:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788864899.804423:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a95 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864899.804436:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864899.804591:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528811648 00000100:00100000:1.0:1788864899.804602:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528811648 00010000:00010000:1.0:1788864899.804860:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959a48 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc92 expref: 16 pid: 5836 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864899.804906:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:1.0:1788864899.804917:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9080ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+16:2359:x1875760528811648:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864899.804956:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864899.804975:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959a48 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc92 expref: 16 pid: 5836 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.804990:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959a48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc92 expref: 16 pid: 5836 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.805016:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959a48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc92 expref: 16 pid: 5836 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.805037:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fdca4f57a00) 00010000:00010000:1.0:1788864899.805052:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a95 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.805064:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.805073:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a95 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.805105:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788864899.805126:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.805133:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864899.805175:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9080ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+15:2359:x1875760528811648:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 260us (740us total) trans 0 rc 0/0 00000001:00080000:2.0:1788864899.806252:0:6705:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000100:00100000:1.0:1788864899.806511:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000001:00080000:2.0:1788864899.807228:0:6705:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1788864899.807304:0:6705:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1788864899.807410:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0361880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6705:1875760546647552:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788864899.807484:0:6705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864899.807521:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc87070240 going to sleep for 11 seconds 00000100:00100000:1.0:1788864899.809496:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546647552 00000100:00100000:1.0:1788864899.809515:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546647552 00000100:00100000:1.0:1788864899.809595:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788864899.809609:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6705:x1875760546647552:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788864899.809807:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6705:x1875760546647552:12345-0@lo:1000:mdt00_003.0 Request processed in 202us (2322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864899.809823:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788864899.810026:0:6705:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1788864899.810037:0:6705:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1788864899.810056:0:6705:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fdca0d5d180, transno 4294967309 00000100:00100000:0.0:1788864899.810097:0:6705:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9fdca0d5ca80 x1875760546646656/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788864915 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864899.810111:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0361880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6705:1875760546647552:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788864899.813101:0:6705:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1788864899.813214:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9080f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6705:1875760546647680:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788864899.813282:0:6705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864899.813321:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfdbed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788864899.813361:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546647680 00000100:00100000:3.0:1788864899.813377:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546647680 00000100:00100000:3.0:1788864899.813674:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788864899.814388:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9080fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6705:x1875760546647680:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788864899.815326:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9080fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6705:x1875760546647680:12345-0@lo:1000:mdt00_003.0 Request processed in 1638us (2039us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788864899.815339:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788864899.815573:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9080f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6705:1875760546647680:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788864899.815633:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.815645:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a95 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.815654:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a95 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.815661:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864899.815666:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a95 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.815676:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a95 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.816099:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fdca4f57a00) 00010000:00010000:0.0:1788864899.816102:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788864899.816110:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a95 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.816117:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959a95 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.816186:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9599d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.816194:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9599d8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.816201:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9599d8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.816206:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864899.816209:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9599d8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.816216:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9599d8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.816225:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:0.0:1788864899.816228:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788864899.816236:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9599df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc76 expref: 18 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.816250:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9599df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc76 expref: 18 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.816260:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9599df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc76 expref: 18 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864899.816306:0:6705:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9599df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc76 expref: 18 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864899.816335:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9080ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6705:1875760546647808:192.168.203.13@tcp:105: 00000100:00100000:0.0:1788864899.816448:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfdbed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788864899.820577:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864899.821456:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528811776 00000100:00100000:1.0:1788864899.821477:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528811776 00000100:00100000:1.0:1788864899.821534:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:1.0:1788864899.821544:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9080d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+19:10583:x1875760528811776:12345-192.168.203.13@tcp:49:lfs.0 00000100:00100000:1.0:1788864899.821662:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9080d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+19:10583:x1875760528811776:12345-192.168.203.13@tcp:49:lfs.0 Request processed in 120us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864899.821671:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:2.0:1788864899.822261:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9080ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6705:1875760546647808:192.168.203.13@tcp:105: 00010000:00010000:2.0:1788864899.822288:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9599d8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.822299:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e9599d8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.822332:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959a9c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.822368:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959a9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.822380:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959a9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.822390:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959a9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.822396:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959a9c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.822401:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959a9c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.822406:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864899.822410:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959a9c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.822416:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959a9c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.822426:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:2.0:1788864899.822429:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864899.822433:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959a9c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.822439:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959a9c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.822449:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959a8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.822461:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959a8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.822467:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959a8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.822472:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864899.822475:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959a8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.822481:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959a8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.822489:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:2.0:1788864899.822491:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788864899.822494:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959a8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.822499:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959a8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864899.824035:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+18:10584:x1875760528811520:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 25159us (25791us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1788864899.824062:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 127 00000020:00080000:3.0:1788864899.824071:0:6705:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788864899.825144:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864899.825262:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528812032 00000100:00100000:1.0:1788864899.825333:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528812032 00000100:00100000:1.0:1788864899.825399:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00100000:1.0:1788864899.825411:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+18:10583:x1875760528812032:12345-192.168.203.13@tcp:58:lfs.0 00000040:00080000:1.0:1788864899.825910:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788864899.826016:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+18:10583:x1875760528812032:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 605us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864899.826025:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00100000:2.0:1788864899.829196:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864899.829307:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528812288 00000100:00100000:1.0:1788864899.829324:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528812288 00000100:00100000:1.0:1788864899.829402:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:1.0:1788864899.829415:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca21f6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+18:10584:x1875760528812288:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788864899.830420:0:5838:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788864899.830565:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1788864899.830634:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959aa3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.830656:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.830683:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.830694:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959aa3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.830750:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959aa3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.830759:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959aa3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.830785:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788864899.830918:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca21f6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+20:10584:x1875760528812288:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 1503us (1745us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788864899.830930:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 32 00000020:00080000:1.0:1788864899.830937:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788864899.830973:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864899.830988:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959aa3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.830996:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75200 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:2.0:1788864899.831001:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959aa3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.831011:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959aa3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.831034:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:2.0:1788864899.831038:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788864899.831046:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959aa3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.831052:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959aa3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.831177:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864899.831182:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788864899.831182:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00010000:00010000:2.0:1788864899.831184:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788864899.831193:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788864899.831272:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788864899.831280:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788864899.831427:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9080c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1875760546647936:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788864899.831593:0:11671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfdbe780 going to sleep for 11 seconds 00000100:00100000:0.0:1788864899.847730:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9080c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1875760546647936:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788864899.851460:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864899.852151:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528812416 00000100:00100000:0.0:1788864899.852167:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528812416 00000100:00100000:0.0:1788864899.852251:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 129 00000100:00100000:0.0:1788864899.852263:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+20:10585:x1875760528812416:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788864899.852325:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788864899.853361:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+20:10585:x1875760528812416:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 1092us (1909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864899.853375:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 129 00000100:00100000:3.0:1788864899.859905:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864899.860032:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528812672 00000100:00100000:2.0:1788864899.860046:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528812672 00000100:00100000:2.0:1788864899.860134:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 130 00000100:00100000:2.0:1788864899.860147:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+20:10585:x1875760528812672:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788864899.860176:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864899.860205:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e959aaa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fcae expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.860340:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e959ab1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.860359:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e959ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.860374:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e959ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864899.860388:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788864899.860619:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e959aaa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcae expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.860642:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e959ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcae expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.860652:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:2.0:1788864899.860656:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788864899.860660:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384200, rc 0) 00000100:00100000:2.0:1788864899.860787:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+22:10585:x1875760528812672:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 642us (898us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788864899.860796:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 130 00000100:00100000:1.0:1788864899.876257:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864899.876550:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528812928 00000100:00100000:3.0:1788864899.876566:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528812928 00000100:00100000:3.0:1788864899.876643:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 131 00000100:00100000:3.0:1788864899.876654:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca0d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+22:10585:x1875760528812928:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788864899.876794:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959abf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.876816:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959abf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.876874:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959abf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.877136:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959abf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.877146:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959abf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.877154:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959abf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.877161:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213ea00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864899.877167:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959abf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.877175:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959abf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.877189:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:3.0:1788864899.877193:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788864899.877198:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959abf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864899.877204:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959abf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864899.877417:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca0d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+23:10585:x1875760528812928:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 763us (1168us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788864899.877427:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 131 00000040:00080000:2.0:1788864899.877906:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788864899.877912:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788864899.878437:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788864899.878448:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788864899.881287:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864899.881658:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528813184 00000100:00100000:1.0:1788864899.882081:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528813184 00000100:00100000:3.0:1788864899.882301:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:3.0:1788864899.882327:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+23:10585:x1875760528813184:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788864899.882649:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+24:10585:x1875760528813184:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 332us (1375us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788864899.882659:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:3.0:1788864899.882876:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864899.882966:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528813312 00000100:00100000:2.0:1788864899.882976:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528813312 00000100:00100000:2.0:1788864899.883047:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 132 00000100:00100000:2.0:1788864899.883058:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+24:10587:x1875760528813312:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788864899.883080:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864899.883173:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e959ac6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fcb5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.883246:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e959acd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.883264:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e959acd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.883297:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e959acd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.883316:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959ad4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.883324:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.883330:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.883618:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959adb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.883631:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9599ca lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc6f expref: 25 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.883640:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959adb lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.886177:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9599ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc6f expref: 25 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.886212:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9599ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc6f expref: 25 pid: 5837 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864899.886235:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0361880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875760546648064:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788864899.886383:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc87070240 going to sleep for 11 seconds 00000100:00100000:0.0:1788864899.891424:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864899.891568:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528813568 00000100:00100000:3.0:1788864899.891583:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528813568 00000100:00100000:3.0:1788864899.891657:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:3.0:1788864899.891666:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9080c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+26:5594:x1875760528813568:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788864899.892230:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9080c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+27:5594:x1875760528813568:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 562us (821us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788864899.892239:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:2.0:1788864899.894456:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0361880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875760546648064:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788864899.894498:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959adb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864899.904637:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864899.904780:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528813696 00000100:00100000:2.0:1788864899.904798:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528813696 00010000:00010000:2.0:1788864899.904888:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9599ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc6f expref: 27 pid: 5837 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864899.904940:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:2.0:1788864899.904952:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+27:2359:x1875760528813696:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788864899.904981:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864899.904989:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9599ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc6f expref: 27 pid: 5837 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.905004:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9599ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc6f expref: 27 pid: 5837 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.905030:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e9599ca lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc6f expref: 27 pid: 5837 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.905050:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:2.0:1788864899.905057:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959adb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.905068:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.905078:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959adb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864899.905139:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864899.905219:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+26:2359:x1875760528813696:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 269us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864899.905227:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00010000:00010000:1.0:1788864899.905627:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.905638:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864899.905697:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788864899.905740:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788864899.905766:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.905798:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.905811:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e959acd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.906029:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e959acd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.906037:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e959acd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.906045:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864899.906049:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e959acd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.906058:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e959acd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.906070:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:1.0:1788864899.906073:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864899.906077:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e959acd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.906084:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384800/0xf8c13e2d0e959acd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.906099:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.906106:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959ad4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.906119:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.906124:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864899.906128:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.906134:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959ad4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.906143:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fdc9124e200) 00010000:00010000:1.0:1788864899.906145:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864899.906148:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959ad4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.906154:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959ad4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.906198:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e959ac6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcb5 expref: 26 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.906213:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959adb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcb5 expref: 25 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864899.906221:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:1.0:1788864899.906223:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788864899.906226:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385400, rc 0) 00000100:00100000:1.0:1788864899.906287:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+25:10587:x1875760528813312:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 23231us (23411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864899.906304:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 132 00000100:00100000:3.0:1788864899.987610:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864899.988344:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864899.988406:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864899.988521:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528813952 00000100:00100000:0.0:1788864899.988532:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528813952 00000100:00100000:0.0:1788864899.988596:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:0.0:1788864899.988607:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2358:x1875760528813952:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788864899.988694:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2358:x1875760528813952:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 88us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864899.988734:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:1.0:1788864899.988955:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528814080 00000100:00100000:1.0:1788864899.988970:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528814080 00000100:00100000:1.0:1788864899.989017:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 132 00000100:00100000:2.0:1788864899.989117:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528813824 00000100:00100000:2.0:1788864899.989132:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528813824 00000100:00100000:2.0:1788864899.989202:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 286 00000100:00100000:2.0:1788864899.989214:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:2358:x1875760528813824:12345-192.168.203.13@tcp:400:kworker.0 00000100:00080000:3.0:1788864899.989230:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788864899.989287:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:2358:x1875760528813824:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 74us (1696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864899.989298:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 286 00000100:00100000:1.0:1788864899.989420:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528814080:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788864899.994273:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528814080:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 5239us (6603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864899.994286:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 132 00010000:00010000:2.0:1788864900.678874:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788864900.714036:0:12092:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788864900.714049:0:12092:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788864900.714100:0:12092:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788864900.714107:0:12092:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788864900.831023:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864900.831119:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528814336 00000100:00100000:2.0:1788864900.831133:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528814336 00000100:00100000:2.0:1788864900.831210:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 133 00000100:00100000:2.0:1788864900.831223:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca0d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+25:10610:x1875760528814336:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788864900.831257:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864900.831285:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e959ae2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fcbc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864900.831442:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959ae9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864900.831473:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959ae9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864900.831488:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959ae9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864900.831502:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788864900.831848:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e959ae2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcbc expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864900.831938:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959ae9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcbc expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864900.831948:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:2.0:1788864900.831961:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788864900.831965:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384a00, rc 0) 00000100:00100000:2.0:1788864900.832735:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca0d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+27:10610:x1875760528814336:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1508us (1723us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788864900.832746:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 133 00000100:00100000:2.0:1788864900.842409:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864900.846933:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528814464 00000100:00100000:0.0:1788864900.846959:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528814464 00000100:00100000:0.0:1788864900.847074:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 134 00000100:00100000:0.0:1788864900.847088:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+27:10610:x1875760528814464:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:0.0:1788864900.847175:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959af7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864900.847198:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959af7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864900.847213:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959af7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864900.847247:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959af7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864900.847254:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959af7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864900.847261:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959af7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864900.847268:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4be00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864900.847273:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959af7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864900.847281:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959af7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864900.847294:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:0.0:1788864900.847309:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788864900.847316:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959af7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864900.847322:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959af7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864900.847416:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+27:10610:x1875760528814464:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 331us (5210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864900.847424:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 134 00000100:00100000:0.0:1788864900.990844:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864900.990977:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528814592 00000100:00100000:2.0:1788864900.990991:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528814592 00000100:00100000:2.0:1788864900.991084:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:2.0:1788864900.991098:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9080d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2357:x1875760528814592:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:2.0:1788864900.991143:0:8199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864900.991172:0:8199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d6e5b84/0xf8c13e2d0e959afe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fcc3 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788864900.991208:0:8199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9fe982, atime: 0x6a9fe982, ctime: 0x6a9fe982, blocks: 0xb 00010000:00010000:2.0:1788864900.991234:0:8199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=324s v=(0 0) 00010000:00010000:2.0:1788864900.991239:0:8199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864900.991250:0:8199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d6e5b84/0xf8c13e2d0e959afe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcc3 expref: 7 pid: 8199 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864900.991272:0:8199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005d6e5b84/0xf8c13e2d0e959afe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcc3 expref: 7 pid: 8199 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864900.991288:0:8199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384800, rc 0) 00000100:00100000:2.0:1788864900.991369:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9080d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2357:x1875760528814592:12345-192.168.203.13@tcp:101:cat.0 Request processed in 275us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864900.991376:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00080000:3.0:1788864900.991593:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788864901.005019:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864901.005124:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528814720 00000100:00100000:1.0:1788864901.005137:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528814720 00002000:00100000:1.0:1788864901.005207:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9fdc9080f100 x1875760528814720/t0(0) o3->1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp:377/0 lens 488/0 e 0 to 0 dl 1788864912 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788864901.005218:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fdc9080f100 with x1875760528814720 ext(0->4095) 00002000:00010000:1.0:1788864901.005227:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fdc9080f100 00000100:00100000:1.0:1788864901.005270:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:1.0:1788864901.005281:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9080f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2357:x1875760528814720:12345-192.168.203.13@tcp:3:cat.0 00000100:00100000:1.0:1788864901.005590:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9080f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2357:x1875760528814720:12345-192.168.203.13@tcp:3:cat.0 Request processed in 309us (594us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788864901.005599:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00002000:00100000:1.0:1788864901.005608:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9fdc9080f100 x1875760528814720/t0(0) o3->1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp:377/0 lens 488/4536 e 0 to 0 dl 1788864912 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788864901.005618:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fdc9080f100 with x1875760528814720 ext(0->4095) 00002000:00010000:1.0:1788864901.005622:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fdc9080f100 00010000:00010000:0.0:1788864901.705097:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864902.470076:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca0d5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546648192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788864902.470141:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864902.470227:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546648192 00000100:00100000:1.0:1788864902.470236:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546648192 00000100:00080000:0.0:1788864902.470277:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788864902.470289:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788864902.470298:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875760546648192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788864902.470331:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788864902.470385:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875760546648192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864902.470393:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788864902.470618:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca0d5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546648192:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788864902.564220:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:3.0:1788864902.568522:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1788864902.568649:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:2.0:1788864902.725093:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788864902.982285:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788864902.982294:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788864902.982322:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788864902.982329:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788864903.492950:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9080ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875760546648448:0@lo:400:kworker.0 00000100:00100000:0.0:1788864903.492957:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9080df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546648576:0@lo:400:kworker.0 00000100:00100000:3.0:1788864903.493038:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864903.493039:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9080d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546648704:0@lo:400:kworker.0 00000100:00100000:2.0:1788864903.493049:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9080c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546648320:0@lo:400:kworker.0 00000100:00100000:0.0:1788864903.493082:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864903.493098:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864903.493124:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546648320 00000100:00100000:0.0:1788864903.493131:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546648320 00000100:00100000:2.0:1788864903.493154:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546648448 00000100:00100000:2.0:1788864903.493159:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546648448 00000100:00100000:3.0:1788864903.493167:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9080dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546648960:0@lo:400:kworker.0 00000100:00100000:0.0:1788864903.493183:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788864903.493195:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3300:x1875760546648320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864903.493198:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788864903.493199:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864903.493210:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875760546648448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864903.493254:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546648704 00000100:00100000:2.0:1788864903.493254:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875760546648448:12345-0@lo:400:kworker.0 Request processed in 47us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864903.493258:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546648704 00000100:00100000:0.0:1788864903.493261:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3300:x1875760546648320:12345-0@lo:400:kworker.0 Request processed in 69us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864903.493276:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788864903.493288:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788864903.493305:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864903.493447:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546648576 00000100:00100000:1.0:1788864903.493451:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546648576 00000100:00100000:1.0:1788864903.493480:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788864903.493488:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546648576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864903.493517:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546648576:12345-0@lo:400:kworker.0 Request processed in 32us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864903.493523:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788864903.494272:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9080c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546648320:0@lo:400:kworker.0 00000100:00100000:0.0:1788864903.494283:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9080c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546648832:0@lo:400:kworker.0 00000100:00100000:0.0:1788864903.494319:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788864903.494370:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864903.494377:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546648960 00000100:00100000:3.0:1788864903.494384:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546648960 00000100:00100000:0.0:1788864903.494389:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546648832 00000100:00100000:0.0:1788864903.494395:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546648832 00000100:00100000:3.0:1788864903.494428:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788864903.494437:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788864903.494439:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9080e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1875760546648704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864903.494450:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9080e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546648832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864903.494488:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9080e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1875760546648704:12345-0@lo:400:kworker.0 Request processed in 52us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864903.494495:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788864903.494510:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788864903.494521:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546648960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864903.494521:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9080e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546648832:12345-0@lo:400:kworker.0 Request processed in 72us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864903.494535:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:0.0:1788864903.494554:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788864903.494557:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788864903.494582:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9080c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546648832:0@lo:400:kworker.0 00000100:00100000:3.0:1788864903.494732:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546648960:12345-0@lo:400:kworker.0 Request processed in 215us (1534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864903.494739:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788864903.494852:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9080d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546648704:0@lo:400:kworker.0 00000100:00100000:3.0:1788864903.494879:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788864903.494884:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1788864903.494899:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fdca0d5c380, transno 4294967304 00000100:00100000:3.0:1788864903.494910:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9080dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546648960:0@lo:400:kworker.0 00000100:00100000:3.0:1788864903.494923:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9080ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875760546648448:0@lo:400:kworker.0 00000100:00100000:2.0:1788864903.500542:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9080df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546648576:0@lo:400:kworker.0 00010000:00010000:1.0:1788864903.749741:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864904.004953:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546649088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788864904.005021:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864904.005411:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546649088 00000100:00100000:3.0:1788864904.005420:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546649088 00000100:00100000:3.0:1788864904.005509:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788864904.005518:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9080c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546649088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788864904.005551:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788864904.006232:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9080c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546649088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 712us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864904.006250:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788864904.006410:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546649088:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788864904.780871:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864905.106407:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864905.106445:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864905.106474:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864905.106478:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528814976 00000100:00100000:1.0:1788864905.106489:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528814976 00000100:00100000:0.0:1788864905.106497:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864905.106513:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864905.106533:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528815360 00000100:00100000:0.0:1788864905.106537:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528815360 00000100:00100000:1.0:1788864905.106554:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 136 00000100:00100000:1.0:1788864905.106567:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9080c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+27:2358:x1875760528814976:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788864905.106578:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 137 00000100:00100000:0.0:1788864905.106588:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9080ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528815360:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788864905.106642:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9080c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+27:2358:x1875760528814976:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 79us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864905.106651:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 136 00000100:00100000:2.0:1788864905.106662:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528814848 00000100:00100000:2.0:1788864905.106669:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528814848 00000100:00080000:1.0:1788864905.106675:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788864905.106717:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 288 00000100:00100000:2.0:1788864905.106725:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+13:2358:x1875760528814848:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864905.107524:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528815232 00000100:00100000:3.0:1788864905.107531:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528815232 00000100:00100000:3.0:1788864905.107568:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528815104 00000100:00100000:3.0:1788864905.107571:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528815104 00000100:00100000:3.0:1788864905.107594:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:3.0:1788864905.107601:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9080f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2358:x1875760528815232:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788864905.108244:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9080ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2358:x1875760528815360:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 1656us (1725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864905.108254:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 137 00000100:00080000:0.0:1788864905.109525:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788864905.109532:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788864905.109602:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:0.0:1788864905.109618:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9080df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2358:x1875760528815104:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788864905.109675:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9080df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2358:x1875760528815104:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 64us (3177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864905.109683:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:2.0:1788864905.112737:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+13:2358:x1875760528814848:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 6001us (6249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864905.112752:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 288 00000001:00080000:1.0:1788864905.113202:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1788864905.113216:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1788864905.113232:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000100:00100000:3.0:1788864905.115381:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9080f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2358:x1875760528815232:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 7616us (8773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864905.115397:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 78 00000001:00080000:3.0:1788864905.118723:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967406 is committed 00000020:00080000:3.0:1788864905.118738:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fdcbfdbe900 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1788864905.118743:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fdc90e09000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fdcbfdbea80 00000020:00080000:3.0:1788864905.118746:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fdc90e09c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fdca1ec8800 00000001:00080000:3.0:1788864905.118767:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967408 is committed 00000001:00080000:3.0:1788864905.118778:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1788864905.118797:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788864905.119243:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788864905.119442:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1788864905.797170:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864905.803670:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864905.803928:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528815488 00000100:00100000:1.0:1788864905.803938:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528815488 00000100:00100000:1.0:1788864905.804000:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 135 00000100:00100000:1.0:1788864905.804010:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9080dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+14:10263:x1875760528815488:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788864905.804122:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9080dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+14:10263:x1875760528815488:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 Request processed in 113us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864905.804130:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 135 00000100:00100000:3.0:1788864905.816076:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864905.816618:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528815744 00000100:00100000:1.0:1788864905.816629:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528815744 00000100:00100000:1.0:1788864905.816692:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:1.0:1788864905.816752:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+14:10263:x1875760528815744:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788864905.817077:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+15:10263:x1875760528815744:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 374us (1009us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788864905.817085:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00010000:00010000:1.0:1788864906.820922:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788864907.545514:0:12293:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 06:55:05 (1788864905) 00000100:00100000:2.0:1788864907.592051:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546649216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788864907.592127:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864907.592206:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546649216 00000100:00100000:2.0:1788864907.592214:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546649216 00000100:00100000:2.0:1788864907.592271:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788864907.592281:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546649216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788864907.592311:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788864907.592355:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546649216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864907.592362:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788864907.592393:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788864907.592416:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1788864907.592421:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fdca0d5ca80, transno 4294967310 00000004:00080000:2.0:1788864907.592439:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1788864907.592463:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546649216:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788864907.845676:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864908.613833:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcacbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546649344:0@lo:400:kworker.0 00000100:00100000:0.0:1788864908.613921:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864908.613925:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875760546649472:0@lo:400:kworker.0 00000100:00100000:1.0:1788864908.613961:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864908.613974:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546649344 00000100:00100000:3.0:1788864908.613984:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546649344 00000100:00100000:1.0:1788864908.613991:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc07c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546649984:0@lo:400:kworker.0 00000100:00100000:0.0:1788864908.613991:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc07c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546649856:0@lo:400:kworker.0 00000100:00100000:1.0:1788864908.614020:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864908.614020:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864908.614032:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788864908.614044:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3300:x1875760546649344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864908.614054:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546649472 00000100:00100000:1.0:1788864908.614057:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546649984 00000100:00100000:0.0:1788864908.614059:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546649472 00000100:00100000:1.0:1788864908.614060:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546649984 00000100:00100000:0.0:1788864908.614084:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546649856 00000100:00100000:0.0:1788864908.614087:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546649856 00000100:00100000:1.0:1788864908.614089:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788864908.614105:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788864908.614109:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546649984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864908.614111:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875760546649472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864908.614739:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546649600:0@lo:400:kworker.0 00000100:00100000:1.0:1788864908.615026:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546649984:12345-0@lo:400:kworker.0 Request processed in 930us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864908.615031:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875760546649472:12345-0@lo:400:kworker.0 Request processed in 919us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864908.615039:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788864908.615046:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3300:x1875760546649344:12345-0@lo:400:kworker.0 Request processed in 1001us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864908.615052:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788864908.615065:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788864908.615072:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9080d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546649856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864908.615106:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9080d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546649856:12345-0@lo:400:kworker.0 Request processed in 34us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864908.615112:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788864908.615206:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788864908.615255:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc07c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546649856:0@lo:400:kworker.0 00000100:00100000:0.0:1788864908.615268:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcacbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3300:1875760546649344:0@lo:400:kworker.0 00000100:00100000:3.0:1788864908.615279:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546649728:0@lo:400:kworker.0 00000100:00100000:3.0:1788864908.615315:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788864908.615315:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788864908.615323:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788864908.615346:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546649728 00000100:00100000:0.0:1788864908.615351:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546649728 00000100:00100000:0.0:1788864908.615385:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788864908.615397:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546649728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864908.615443:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546649728:12345-0@lo:400:kworker.0 Request processed in 50us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864908.615448:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788864908.615652:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc07c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546649984:0@lo:400:kworker.0 00000100:00100000:1.0:1788864908.615670:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875760546649472:0@lo:400:kworker.0 00000100:00100000:2.0:1788864908.616040:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864908.616084:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546649600 00000100:00100000:1.0:1788864908.616089:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546649600 00000100:00100000:1.0:1788864908.616243:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788864908.616251:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546649600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864908.616260:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546649728:0@lo:400:kworker.0 00000100:00080000:0.0:1788864908.616311:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788864908.616632:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546649600:12345-0@lo:400:kworker.0 Request processed in 381us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864908.616639:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788864908.616689:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546649600:0@lo:400:kworker.0 00000100:00100000:2.0:1788864908.639106:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864908.639306:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528816000 00000100:00100000:0.0:1788864908.639320:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528816000 00000100:00080000:2.0:1788864908.639477:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788864908.639587:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 136 00000100:00100000:0.0:1788864908.639602:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+15:11320:x1875760528816000:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788864908.639636:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864908.639664:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959b05 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fcca expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864908.639924:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959b0c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864908.639961:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959b0c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864908.639980:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959b0c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864908.640000:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959b13 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864908.640008:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959b13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864908.640015:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959b13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864908.640605:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959b1a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864908.640618:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959b1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864908.640626:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959b1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864908.640638:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788864908.641096:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959b0c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864908.641107:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959b0c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864908.641119:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959b0c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864908.641137:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4b200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864908.641141:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959b0c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864908.641150:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959b0c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864908.641166:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fdc8328e400) 00010000:00010000:0.0:1788864908.641169:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864908.641175:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959b0c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864908.641182:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959b0c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864908.641202:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959b13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864908.641207:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959b13 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864908.641213:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959b13 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864908.644137:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4b600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864908.644147:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959b13 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864908.644160:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959b13 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864908.644211:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fdca4f57000) 00010000:00010000:0.0:1788864908.644482:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864908.644490:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959b13 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864908.644500:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959b13 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864908.651103:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959b05 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcca expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864908.651143:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959b1a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcca expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864908.651155:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fdca4f57c00) 00010000:00010000:0.0:1788864908.651158:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864908.651163:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4be00, rc 0) 00000100:00100000:0.0:1788864908.652264:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+17:11320:x1875760528816000:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 12656us (13161us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788864908.652279:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 136 00000100:00100000:0.0:1788864908.659211:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864908.659343:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864908.659507:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528816128 00000100:00100000:2.0:1788864908.659520:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528816128 00000100:00100000:2.0:1788864908.659607:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:2.0:1788864908.659621:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9080ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+17:2356:x1875760528816128:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788864908.659642:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864908.659675:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959b1a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcca expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864908.659699:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fdca4f57c00) 00010000:00010000:2.0:1788864908.659746:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864908.659905:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9080ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+16:2356:x1875760528816128:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 208us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864908.659915:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:1.0:1788864908.660865:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528816256 00000100:00100000:1.0:1788864908.660874:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528816256 00000100:00100000:1.0:1788864908.660935:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 137 00000100:00100000:1.0:1788864908.660945:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9080d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+16:11320:x1875760528816256:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788864908.661062:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9080d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+16:11320:x1875760528816256:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 Request processed in 119us (1718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864908.661070:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 137 00010000:00010000:1.0:1788864908.872145:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788864909.125366:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788864909.125380:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788864909.125921:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000100:00100000:0.0:1788864909.126220:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788864909.126248:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9080ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546650112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788864909.126343:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864909.126427:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546650112 00000100:00100000:0.0:1788864909.126436:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546650112 00000100:00100000:0.0:1788864909.126507:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788864909.126518:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9080ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546650112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788864909.126572:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788864909.126632:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9080ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546650112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864909.126640:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788864909.126699:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9080ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546650112:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788864909.127416:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788864909.896190:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788864910.211069:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1788864910.211099:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788864910.211152:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788864910.211168:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788864910.228047:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864910.228085:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864910.228113:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864910.228140:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864910.228173:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864910.228196:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528816640 00000100:00100000:0.0:1788864910.228197:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528816896 00000100:00100000:1.0:1788864910.228208:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528816640 00000100:00100000:0.0:1788864910.228208:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528816896 00000100:00100000:2.0:1788864910.228302:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528816384 00000100:00100000:2.0:1788864910.228308:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528816384 00000100:00100000:2.0:1788864910.228371:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 290 00000100:00100000:1.0:1788864910.228380:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528816768 00000100:00100000:2.0:1788864910.228382:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+13:2356:x1875760528816384:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788864910.228383:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528816768 00000100:00100000:1.0:1788864910.228405:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:1.0:1788864910.228412:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9080ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2356:x1875760528816640:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788864910.228470:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+13:2356:x1875760528816384:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 91us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864910.228478:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 290 00000100:00100000:0.0:1788864910.228818:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528816512 00000100:00100000:0.0:1788864910.228823:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528816512 00000100:00100000:0.0:1788864910.228850:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 141 00000100:00100000:0.0:1788864910.228857:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9080f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2356:x1875760528816896:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788864910.233133:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9080ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2356:x1875760528816640:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 4702us (5027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864910.233152:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:1.0:1788864910.233193:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:1.0:1788864910.233209:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca0d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2356:x1875760528816768:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788864910.233285:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca0d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2356:x1875760528816768:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 83us (5109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864910.233292:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00080000:1.0:1788864910.234806:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788864910.234817:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788864910.234821:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788864910.234860:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 142 00000100:00100000:1.0:1788864910.234879:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+14:2356:x1875760528816512:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788864910.234981:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+14:2356:x1875760528816512:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 110us (6839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864910.234989:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 142 00000100:00100000:0.0:1788864910.241275:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9080f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2356:x1875760528816896:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 12404us (13146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864910.241293:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 141 00000100:00100000:2.0:1788864910.889305:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864910.891633:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528817024 00000100:00100000:1.0:1788864910.891657:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528817024 00000100:00100000:1.0:1788864910.891789:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 138 00000100:00100000:1.0:1788864910.891804:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+14:11362:x1875760528817024:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788864910.891833:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864910.891862:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e959b28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fcd1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.891957:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959b2f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.891995:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959b2f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.892012:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959b2f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.892034:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959b36 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.892042:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959b36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.892048:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959b36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.892335:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959b2f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.892345:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959b2f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.892352:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959b2f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.892358:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864910.892363:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959b2f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.892372:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959b2f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.892678:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdca4f57300) 00010000:00010000:1.0:1788864910.892689:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864910.892696:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959b2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.892775:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959b2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.892789:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959b36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.892796:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959b36 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.892803:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959b36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.892808:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864910.892811:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959b36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.892817:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959b36 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.892825:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fdc8328e100) 00010000:00010000:1.0:1788864910.892827:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864910.892830:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959b36 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.892836:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959b36 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.892878:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e959b28 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcd1 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.892910:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdca4f57300) 00010000:00010000:1.0:1788864910.892912:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864910.892916:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e959b28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcd1 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.892927:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc75800, rc 0) 00000100:00100000:1.0:1788864910.893043:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+14:11362:x1875760528817024:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1242us (3753us total) trans 0 rc 301/301 00000100:00100000:1.0:1788864910.893053:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 138 00000100:00100000:1.0:1788864910.904624:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864910.907301:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528817280 00000100:00100000:2.0:1788864910.907323:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528817280 00000100:00100000:2.0:1788864910.907519:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 139 00000100:00100000:2.0:1788864910.907533:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+14:11362:x1875760528817280:12345-192.168.203.13@tcp:36:lfs.0 00010000:00010000:2.0:1788864910.907610:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864910.907646:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e9594b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb11 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864910.907668:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdca4f57300) 00010000:00010000:2.0:1788864910.907682:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788864910.907993:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959b3d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864910.908011:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959b3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864910.908023:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959b3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864910.908046:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959b44 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864910.908054:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959b44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864910.908061:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959b44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864910.911849:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788864910.911875:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959b3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864910.911901:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959b3d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864910.911909:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959b3d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864910.911916:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864910.911922:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959b3d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864910.911931:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959b3d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864910.911955:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:2.0:1788864910.911958:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864910.911965:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959b3d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864910.911985:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959b3d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788864910.912011:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082232826 reply state 00000000efbe6cef transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959b44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864910.912020:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788864910.912168:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+15:11362:x1875760528817280:12345-192.168.203.13@tcp:36:lfs.0 Request processed in 4632us (7553us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788864910.912180:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 139 00010000:00010000:1.0:1788864910.916891:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864910.917890:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959b44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.917910:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959b44 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.917920:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959b44 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.917927:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864910.917932:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959b44 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.917941:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959b44 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.917962:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fdc9124ec00) 00010000:00010000:1.0:1788864910.917974:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864910.917980:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959b44 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864910.917988:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959b44 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864911.000150:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864911.000254:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528817408 00000100:00100000:3.0:1788864911.000272:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528817408 00000100:00100000:3.0:1788864911.000355:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 140 00000100:00100000:3.0:1788864911.000368:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+14:11370:x1875760528817408:12345-192.168.203.13@tcp:101:lctl.0 00010000:00010000:3.0:1788864911.000401:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864911.000431:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959b4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fcd8 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864911.000522:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e959b52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864911.000538:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e959b52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864911.000552:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e959b52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788864911.000600:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788864911.000604:0:6705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788864911.000631:0:6705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e959b52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864911.000661:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959b4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcd8 expref: 16 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864911.000682:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e959b52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcd8 expref: 15 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864911.000750:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc834b8000) 00010000:00010000:3.0:1788864911.000752:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788864911.000756:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213f400, rc 0) 00000100:00100000:3.0:1788864911.000834:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+15:11370:x1875760528817408:12345-192.168.203.13@tcp:101:lctl.0 Request processed in 468us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864911.000842:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 140 00000100:00100000:3.0:1788864911.057310:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864911.057962:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528817536 00000100:00100000:1.0:1788864911.057977:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528817536 00000100:00100000:1.0:1788864911.058125:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 141 00000100:00100000:1.0:1788864911.058138:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+15:11376:x1875760528817536:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788864911.058165:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864911.058193:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e959b59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fcdf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.058280:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959b60 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.058298:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959b60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.058313:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959b60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.058331:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959b67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.058338:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959b67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.058344:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959b67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.058489:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e959b6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.058498:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e959b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.058505:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e959b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864911.058537:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788864911.058541:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788864911.058563:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e959b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.059307:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959b60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.059320:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959b60 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.059328:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959b60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.059335:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864911.059340:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959b60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.059349:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959b60 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.059366:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc834b8000) 00010000:00010000:1.0:1788864911.059381:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864911.059388:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959b60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.059395:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959b60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.059413:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959b67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.059419:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959b67 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.059425:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959b67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.059430:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864911.059433:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959b67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.059439:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959b67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.059448:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fdc8328e100) 00010000:00010000:1.0:1788864911.059450:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864911.059453:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959b67 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.059459:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959b67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.059505:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e959b59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcdf expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.059534:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e959b6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcdf expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.059542:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:1.0:1788864911.059544:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788864911.059547:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc74200, rc 0) 00000100:00100000:1.0:1788864911.059650:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+16:11376:x1875760528817536:12345-192.168.203.13@tcp:101:bash.0 Request processed in 1515us (2352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864911.059661:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 141 00000100:00100000:0.0:1788864911.063159:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864911.063309:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528817792 00000100:00100000:1.0:1788864911.063322:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528817792 00000100:00100000:1.0:1788864911.063453:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 142 00000100:00100000:1.0:1788864911.063475:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca0d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+16:11376:x1875760528817792:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788864911.063504:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864911.063533:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959b75 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fce6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.063687:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959b7c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.063757:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959b7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.063772:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959b7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.063788:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959b83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.063813:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959b83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.063821:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959b83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788864911.064557:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1788864911.064819:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959b8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.064834:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959b8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.064845:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959b8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.064903:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959b7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.064912:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959b7c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.064920:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959b7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.064927:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864911.064933:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959b7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.064941:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959b7c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.064971:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:1.0:1788864911.064975:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864911.064981:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959b7c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.064988:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959b7c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788864911.065005:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f736c44b reply state 00000000e610593b transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959b83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864911.065016:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788864911.065060:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959b75 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fce6 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.065077:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959b8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fce6 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.065084:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc8328ee00) 00010000:00010000:1.0:1788864911.065087:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788864911.065090:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc74800, rc 0) 00000100:00100000:1.0:1788864911.065192:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca0d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+19:11376:x1875760528817792:12345-192.168.203.13@tcp:101:bash.0 Request processed in 1719us (2049us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788864911.065203:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 142 00010000:00010000:1.0:1788864911.075043:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959b83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.075069:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959b83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.075104:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959b83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.075111:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864911.075117:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959b83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.075126:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959b83 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.075147:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fdc8328ed00) 00010000:00010000:1.0:1788864911.075151:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864911.075157:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959b83 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.075164:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959b83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864911.075935:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864911.076157:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528817920 00000100:00100000:1.0:1788864911.076175:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528817920 00000100:00100000:1.0:1788864911.076251:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:1.0:1788864911.076263:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca0d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2358:x1875760528817920:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788864911.076286:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864911.076311:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1999677/0xf8c13e2d0e959b98 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fced expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788864911.076345:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788864911.076369:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=334s v=(0 0) 00010000:00010000:1.0:1788864911.076396:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864911.076407:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1999677/0xf8c13e2d0e959b98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fced expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.076431:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d1999677/0xf8c13e2d0e959b98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fced expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.076447:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc75800, rc 0) 00000100:00100000:1.0:1788864911.076527:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca0d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2358:x1875760528817920:12345-192.168.203.13@tcp:101:bash.0 Request processed in 267us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864911.076535:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:0.0:1788864911.079316:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864911.083173:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528818048 00000100:00100000:1.0:1788864911.083193:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528818048 00000100:00100000:1.0:1788864911.083289:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:1.0:1788864911.083302:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:11376:x1875760528818048:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788864911.083326:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864911.083349:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959b9f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fcf4 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.083391:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1999677/0xf8c13e2d0e959b98 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fced expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.083400:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864911.083404:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864911.083409:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959b9f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcf4 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.083480:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d1999677/0xf8c13e2d0e959b98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fced expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.083496:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d1999677/0xf8c13e2d0e959b98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fced expref: 7 pid: 6685 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864911.083516:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1875760546650240:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788864911.084403:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc909026c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864911.091599:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1875760546650240:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788864911.091736:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959b9f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcf4 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.091763:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc75200, rc 0) 00000100:00100000:2.0:1788864911.091875:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:11376:x1875760528818048:12345-192.168.203.13@tcp:101:bash.0 Request processed in 8575us (12571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864911.091894:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:3.0:1788864911.095205:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864911.095319:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528818176 00000100:00100000:0.0:1788864911.095332:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528818176 00010000:00010000:0.0:1788864911.095448:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d1999677/0xf8c13e2d0e959b98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fced expref: 7 pid: 6685 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864911.095620:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:0.0:1788864911.095634:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2359:x1875760528818176:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788864911.095655:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864911.095687:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d1999677/0xf8c13e2d0e959b98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fced expref: 7 pid: 6685 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864911.095759:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d1999677/0xf8c13e2d0e959b98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fced expref: 7 pid: 6685 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864911.095790:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1999677/0xf8c13e2d0e959b98 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fced expref: 7 pid: 6685 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864911.095817:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788864911.095822:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788864911.095831:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959b9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcf4 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864911.095842:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959b9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcf4 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864911.095903:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959b9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcf4 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864911.095939:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcafcbad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5820:1875760546650368:192.168.203.13@tcp:105: 00000100:00100000:0.0:1788864911.096043:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598480 going to sleep for 11 seconds 00000100:00100000:0.0:1788864911.100324:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864911.100930:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcafcbad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5820:1875760546650368:192.168.203.13@tcp:105: 00010000:00010000:1.0:1788864911.100962:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864911.101045:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2359:x1875760528818176:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 5413us (5853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864911.101059:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:3.0:1788864911.102356:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528818432 00000100:00100000:3.0:1788864911.102373:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528818432 00000100:00100000:3.0:1788864911.102584:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:3.0:1788864911.102597:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+18:11376:x1875760528818432:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:3.0:1788864911.103487:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+19:11376:x1875760528818432:12345-192.168.203.13@tcp:35:bash.0 Request processed in 886us (3172us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788864911.103499:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:0.0:1788864911.182700:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864911.182820:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528818688 00000100:00100000:2.0:1788864911.182833:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528818688 00000100:00100000:2.0:1788864911.182959:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 143 00000100:00100000:2.0:1788864911.182972:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+19:11386:x1875760528818688:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788864911.183008:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864911.183035:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959ba6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fcfb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864911.183202:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788864911.183357:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959ba6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcfb expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.183375:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc834b8000) 00010000:00010000:2.0:1788864911.183379:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788864911.183385:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959ba6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcfb expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.183401:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384000, rc 0) 00000100:00100000:2.0:1788864911.183482:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+20:11386:x1875760528818688:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 512us (792us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1788864911.183490:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 143 00000100:00100000:0.0:1788864911.191640:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864911.191750:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528818944 00000100:00100000:2.0:1788864911.191764:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528818944 00000100:00100000:2.0:1788864911.191983:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:2.0:1788864911.191996:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+20:11386:x1875760528818944:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788864911.192660:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+21:11386:x1875760528818944:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 664us (1032us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788864911.192670:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:0.0:1788864911.276541:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864911.277506:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528819072 00000100:00100000:3.0:1788864911.277521:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528819072 00000100:00100000:3.0:1788864911.277652:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 144 00000100:00100000:3.0:1788864911.277666:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+21:11392:x1875760528819072:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788864911.277737:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864911.278134:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959bb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fd02 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864911.278227:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959bbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864911.278272:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864911.278299:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788864911.278348:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788864911.278353:0:6705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788864911.278537:0:6705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864911.278571:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959bb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd02 expref: 23 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864911.278646:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959bbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd02 expref: 22 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864911.278666:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:3.0:1788864911.278670:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788864911.278675:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213e600, rc 0) 00000100:00100000:3.0:1788864911.280592:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+22:11392:x1875760528819072:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 2912us (4049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864911.280608:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 144 00000100:00100000:0.0:1788864911.284186:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864911.284300:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528819328 00000100:00100000:1.0:1788864911.284315:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528819328 00000100:00100000:1.0:1788864911.284404:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 145 00000100:00100000:1.0:1788864911.284418:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+22:11392:x1875760528819328:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788864911.284446:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864911.284476:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959bc2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fd09 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.284609:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959bc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.284943:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.284978:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864911.284995:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788864911.285183:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959bc2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd09 expref: 25 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.285205:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd09 expref: 24 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.285215:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc8328ee00) 00010000:00010000:1.0:1788864911.285218:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788864911.285223:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc75400, rc 0) 00000100:00100000:1.0:1788864911.285297:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+24:11392:x1875760528819328:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 882us (1124us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1788864911.285305:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 145 00000100:00100000:0.0:1788864911.292003:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864911.292055:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864911.292144:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528819584 00000100:00100000:1.0:1788864911.292158:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528819584 00000100:00100000:1.0:1788864911.292239:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 146 00000100:00100000:1.0:1788864911.292253:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+24:11392:x1875760528819584:12345-192.168.203.13@tcp:101:lfs.0 00000100:00100000:3.0:1788864911.292257:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528819712 00000100:00100000:3.0:1788864911.292262:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528819712 00010000:00010000:1.0:1788864911.292287:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864911.292315:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959bd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fd10 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864911.292323:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:3.0:1788864911.292330:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+26:2357:x1875760528819712:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788864911.292346:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864911.292389:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959bc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd09 expref: 26 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864911.292407:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc8328ee00) 00010000:00010000:3.0:1788864911.292413:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788864911.292480:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+25:2357:x1875760528819712:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 149us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864911.292488:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00010000:00010000:0.0:1788864911.296197:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e959bde lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864911.296230:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e959bde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864911.296246:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e959bde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864911.296278:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788864911.296575:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959bd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd10 expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864911.296599:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e959bde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd10 expref: 25 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864911.296608:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc8328ee00) 00010000:00010000:0.0:1788864911.296611:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788864911.296735:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4ac00, rc 0) 00000100:00100000:0.0:1788864911.296846:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+25:11392:x1875760528819584:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 4595us (4855us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788864911.296857:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 146 00000100:00100000:0.0:1788864911.301982:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864911.302065:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528819840 00000100:00100000:1.0:1788864911.302080:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528819840 00000100:00100000:1.0:1788864911.302157:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:1.0:1788864911.302187:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2358:x1875760528819840:12345-192.168.203.13@tcp:1:lfs.0 00010000:00010000:1.0:1788864911.302251:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959bec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.302277:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959b9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcf4 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.302288:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864911.302293:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788864911.302299:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959bec lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.302345:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959b9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcf4 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.302363:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959b9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcf4 expref: 6 pid: 6682 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864911.302381:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1875760546650496:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788864911.302584:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc90902300 going to sleep for 11 seconds 00000100:00100000:3.0:1788864911.308419:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864911.308488:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528819968 00000100:00100000:0.0:1788864911.308500:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528819968 00002000:00100000:0.0:1788864911.308566:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9fdcc07c5880 x1875760528819968/t0(0) o4->1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp:387/0 lens 504/0 e 0 to 0 dl 1788864922 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788864911.308578:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fdcc07c5880 with x1875760528819968 ext(0->12) 00010000:00010000:0.0:1788864911.308590:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959b9f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcf4 expref: 7 pid: 6682 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864911.308610:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959b9f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcf4 expref: 7 pid: 6682 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788864911.308631:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fdcc07c5880 00000100:00100000:0.0:1788864911.308667:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:0.0:1788864911.308678:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2359:x1875760528819968:12345-192.168.203.13@tcp:4:lfs.0 00000100:00100000:0.0:1788864911.309366:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:2359:x1875760528819968:12345-192.168.203.13@tcp:4:lfs.0 Request processed in 685us (958us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788864911.309376:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00002000:00100000:0.0:1788864911.309386:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9fdcc07c5880 x1875760528819968/t4294967305(0) o4->1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp:387/0 lens 504/448 e 0 to 0 dl 1788864922 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788864911.309395:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fdcc07c5880 with x1875760528819968 ext(0->12) 00010000:00010000:0.0:1788864911.309402:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959b9f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcf4 expref: 9 pid: 6682 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864911.309420:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959b9f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcf4 expref: 9 pid: 6682 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788864911.309428:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fdcc07c5880 00000100:00100000:1.0:1788864911.309627:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1875760546650496:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788864911.309663:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959bec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864911.314147:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864911.314275:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528820096 00000100:00100000:1.0:1788864911.314289:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528820096 00010000:00010000:1.0:1788864911.314362:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959b9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcf4 expref: 9 pid: 6682 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864911.314425:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:1.0:1788864911.314437:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:2359:x1875760528820096:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864911.314457:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788864911.314484:0:5820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788864911.314487:0:5820:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788864910 00002000:00010000:1.0:1788864911.314490:0:5820:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788864910 00002000:00010000:1.0:1788864911.314492:0:5820:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788864910 00010000:00010000:1.0:1788864911.314499:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959b9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcf4 expref: 9 pid: 6682 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.314515:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959b9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcf4 expref: 9 pid: 6682 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.314544:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012d3ab9f/0xf8c13e2d0e959b9f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcf4 expref: 9 pid: 6682 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.314566:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788864911.314571:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788864911.314578:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959bec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.314590:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959bec lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.314666:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864911.314803:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2359:x1875760528820096:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 368us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864911.314812:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00010000:00010000:0.0:1788864911.316610:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959bec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864911.316642:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959bec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864911.316694:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959bec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864911.316863:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959bec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864911.316875:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959bec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864911.316895:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74000 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788864911.316901:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959bec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864911.316912:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959bec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864911.316964:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959bec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864911.316973:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cd99048/0xf8c13e2d0e959bec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864911.317111:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2358:x1875760528819840:12345-192.168.203.13@tcp:1:lfs.0 Request processed in 14923us (15138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864911.317123:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:0.0:1788864911.321562:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864911.322535:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528820352 00000100:00100000:3.0:1788864911.322554:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528820352 00000100:00100000:3.0:1788864911.322644:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:3.0:1788864911.322657:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca21f5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+25:11392:x1875760528820352:12345-192.168.203.13@tcp:35:lfs.0 00000004:00010000:3.0:1788864911.322802:0:5839:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e959bde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd10 expref: 25 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788864911.323196:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1788864911.323246:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1788864911.326512:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1788864911.326633:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959bf3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864911.326660:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959b8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fce6 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864911.326670:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959bf3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864911.326759:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959b8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fce6 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864911.326790:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959b8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fce6 expref: 29 pid: 5835 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864911.326810:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc07c7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5839:1875760546650624:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788864911.326951:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcacbe0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788864911.334345:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc07c7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5839:1875760546650624:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788864911.334470:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959bf3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864911.337564:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864911.337854:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528820480 00000100:00100000:2.0:1788864911.337868:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528820480 00010000:00010000:2.0:1788864911.337940:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959b8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fce6 expref: 30 pid: 5835 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864911.338042:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:2.0:1788864911.338078:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+30:2358:x1875760528820480:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788864911.338097:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864911.338105:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959b8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fce6 expref: 30 pid: 5835 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.338121:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959b8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fce6 expref: 30 pid: 5835 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.338144:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959b8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fce6 expref: 30 pid: 5835 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.338163:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc8328ee00) 00010000:00010000:2.0:1788864911.338169:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959bf3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.338181:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959bf3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.338189:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959bf3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.338226:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864911.338295:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+29:2358:x1875760528820480:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 219us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864911.338303:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00010000:00010000:0.0:1788864911.338363:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959bf3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864911.338374:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959bf3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788864911.338534:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788864911.338821:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1788864911.338953:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcafcbbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1875760546650752:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788864911.339015:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864911.339054:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598180 going to sleep for 11 seconds 00000100:00100000:1.0:1788864911.339106:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546650752 00000100:00100000:1.0:1788864911.339115:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546650752 00000100:00100000:1.0:1788864911.339175:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788864911.339183:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1875760546650752:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788864911.339272:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1875760546650752:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 91us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864911.339280:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788864911.342887:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788864911.342986:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcafcbbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1875760546650752:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788864911.343656:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1788864911.343805:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcafcbbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1875760546650880:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788864911.343922:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864911.343966:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598600 going to sleep for 11 seconds 00000100:00100000:1.0:1788864911.343993:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546650880 00000100:00100000:1.0:1788864911.344005:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546650880 00000100:00100000:1.0:1788864911.344075:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788864911.344087:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1875760546650880:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788864911.344507:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1875760546650880:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 420us (585us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788864911.344517:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788864911.344589:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcafcbbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1875760546650880:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788864911.344663:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1788864911.344731:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959bf3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.345038:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959bf3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.345048:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959bf3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.345055:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213f600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864911.345060:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959bf3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.345070:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959bf3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.345090:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc8328ee00) 00010000:00010000:2.0:1788864911.345093:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788864911.345098:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959bf3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.345105:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959bf3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788864911.345306:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788864911.345534:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1788864911.345545:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 334476840758ns, next at 335476838443ns, rc = 0 00000001:00080000:2.0:1788864911.345554:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1788864911.345589:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc8328ee00) 00010000:00010000:2.0:1788864911.345593:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788864911.345600:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e959bde lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd10 expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864911.346084:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca21f5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+32:11392:x1875760528820352:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 23429us (24533us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1788864911.346098:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000020:00080000:2.0:1788864911.346104:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788864911.350658:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864911.351062:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528820608 00000100:00100000:2.0:1788864911.351077:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528820608 00000100:00100000:2.0:1788864911.351202:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 147 00000100:00100000:2.0:1788864911.351216:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+32:11392:x1875760528820608:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788864911.351250:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864911.351294:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959bfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fd17 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.351695:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959bfa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd17 expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.351858:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959bfa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd17 expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.351891:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:2.0:1788864911.351895:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788864911.351900:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385800, rc 0) 00000100:00100000:2.0:1788864911.351985:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+33:11392:x1875760528820608:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 772us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864911.351994:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 147 00000100:00100000:3.0:1788864911.356903:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864911.357027:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528820864 00000100:00100000:2.0:1788864911.357041:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528820864 00000100:00100000:2.0:1788864911.357139:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:2.0:1788864911.357153:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+33:11392:x1875760528820864:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788864911.360201:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+34:11392:x1875760528820864:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 1199us (1471us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788864911.360237:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:1.0:1788864911.462873:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864911.464775:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528821120 00000100:00100000:2.0:1788864911.464793:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528821120 00000100:00100000:2.0:1788864911.464890:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 148 00000100:00100000:2.0:1788864911.464904:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+34:11402:x1875760528821120:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788864911.464940:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864911.464970:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959c01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fd1e expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864911.465094:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788864911.465249:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959c01 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd1e expref: 36 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.465265:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc834b8000) 00010000:00010000:2.0:1788864911.465269:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788864911.465274:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959c01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd1e expref: 36 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.465487:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384000, rc 0) 00000100:00100000:2.0:1788864911.465584:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+35:11402:x1875760528821120:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 682us (2725us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788864911.465592:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 148 00000100:00100000:0.0:1788864911.474318:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864911.474605:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528821248 00000100:00100000:1.0:1788864911.474619:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528821248 00000100:00100000:2.0:1788864911.474774:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 149 00000100:00100000:2.0:1788864911.474797:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+35:11402:x1875760528821248:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:2.0:1788864911.474921:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c0f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.474941:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.474956:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.474974:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.474982:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.474988:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.475105:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959c1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.475115:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.475123:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788864911.475178:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.475194:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.475208:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c0f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.475216:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.475223:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864911.475228:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.475237:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c0f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.475252:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:2.0:1788864911.475255:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864911.475263:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.475270:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.476013:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.476026:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.476032:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.476038:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864911.476054:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.476062:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.476074:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fdc9124e700) 00010000:00010000:2.0:1788864911.476077:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864911.476081:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c16 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.476087:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.476107:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.476114:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959c1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.476120:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959c1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.476125:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864911.476128:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959c1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.476134:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959c1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.476141:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:2.0:1788864911.476144:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864911.476154:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959c1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.476160:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959c1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864911.476277:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+35:11402:x1875760528821248:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 1480us (1969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864911.476297:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 149 00000100:00100000:3.0:1788864911.479058:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864911.479688:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528821504 00000100:00100000:0.0:1788864911.479752:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528821504 00000100:00100000:0.0:1788864911.479824:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:0.0:1788864911.479836:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+35:11402:x1875760528821504:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1788864911.480165:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+36:11402:x1875760528821504:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 330us (1121us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788864911.480174:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:1.0:1788864911.537324:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864911.537794:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528821760 00000100:00100000:2.0:1788864911.537808:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528821760 00000100:00100000:2.0:1788864911.537899:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00100000:2.0:1788864911.537912:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+36:11405:x1875760528821760:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788864911.537946:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864911.537974:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959c24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fd25 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.538076:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.538095:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.538110:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.538129:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.538138:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.538169:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.538328:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959c39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.538338:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959c39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.538347:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959c39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864911.542846:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788864911.543071:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.543088:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.543098:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.543105:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864911.543111:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.543121:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.543143:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:2.0:1788864911.543146:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864911.543171:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.543179:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.543201:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.543209:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.543215:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.543221:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864911.543224:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.543231:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.543240:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fdc9124e700) 00010000:00010000:2.0:1788864911.543242:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864911.543246:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.543252:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.543325:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959c24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd25 expref: 39 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.543368:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959c39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd25 expref: 38 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.543377:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:2.0:1788864911.543379:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788864911.543943:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384000, rc 0) 00000100:00100000:3.0:1788864911.544324:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+38:11405:x1875760528821760:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 6410us (7011us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1788864911.544337:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00100000:0.0:1788864911.549070:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864911.549179:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528821888 00000100:00100000:1.0:1788864911.549193:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528821888 00000100:00100000:1.0:1788864911.549295:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 151 00000100:00100000:1.0:1788864911.549308:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+38:11405:x1875760528821888:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:1.0:1788864911.549421:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959c47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.549444:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.549461:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.549496:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.549504:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959c47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.549513:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959c47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.549520:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864911.549526:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959c47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.549534:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959c47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.549548:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:1.0:1788864911.549551:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788864911.549576:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959c47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.549583:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959c47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864911.549689:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+38:11405:x1875760528821888:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 382us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864911.549697:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 151 00000100:00100000:0.0:1788864911.554199:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864911.554319:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528822144 00000100:00100000:2.0:1788864911.554334:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528822144 00000100:00100000:2.0:1788864911.554598:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:2.0:1788864911.554612:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+38:11405:x1875760528822144:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788864911.554970:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+39:11405:x1875760528822144:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 360us (784us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788864911.554978:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:3.0:1788864911.859745:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864911.860059:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528822400 00000100:00100000:0.0:1788864911.860073:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528822400 00000100:00100000:0.0:1788864911.860149:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 152 00000100:00100000:0.0:1788864911.860161:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+39:11436:x1875760528822400:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:0.0:1788864911.860194:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864911.860220:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e959c4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fd2c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864911.860358:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959c55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864911.860379:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864911.860394:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864911.860428:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788864911.860660:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e959c4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd2c expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864911.860682:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959c55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd2c expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864911.860692:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:0.0:1788864911.860695:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788864911.860699:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4b400, rc 0) 00000100:00100000:0.0:1788864911.861112:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+41:11436:x1875760528822400:12345-192.168.203.13@tcp:101:cat.0 Request processed in 951us (1406us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788864911.861121:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 152 00000100:00100000:0.0:1788864911.865402:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864911.865461:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864911.865654:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528822784 00000100:00100000:1.0:1788864911.865669:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528822784 00000100:00100000:1.0:1788864911.865807:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:1.0:1788864911.865820:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+41:2359:x1875760528822784:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864911.865852:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864911.865897:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959c55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd2c expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.865921:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:1.0:1788864911.865928:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864911.866003:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+40:2359:x1875760528822784:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 186us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864911.866012:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:2.0:1788864911.867022:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528822656 00000100:00100000:2.0:1788864911.867036:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528822656 00000100:00100000:2.0:1788864911.867105:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:2.0:1788864911.867116:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+40:11436:x1875760528822656:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:2.0:1788864911.867428:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+41:11436:x1875760528822656:12345-192.168.203.13@tcp:35:cat.0 Request processed in 312us (2051us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788864911.867437:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:0.0:1788864911.931083:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864911.931199:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528823040 00000100:00100000:2.0:1788864911.931213:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528823040 00000100:00100000:2.0:1788864911.931294:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 153 00000100:00100000:2.0:1788864911.931307:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+41:11442:x1875760528823040:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:2.0:1788864911.931350:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864911.931353:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788864911.931393:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959bbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd02 expref: 41 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.931415:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:2.0:1788864911.931422:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788864911.931438:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959c63 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fd33 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.931584:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c6a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.931602:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959c39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd25 expref: 41 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.931612:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c6a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.931666:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959c39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd25 expref: 41 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.931682:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959c39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd25 expref: 41 pid: 6705 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864911.931698:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0555180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875760546651008:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788864911.932076:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc84e8f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788864911.936335:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864911.936441:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528823168 00000100:00100000:1.0:1788864911.936454:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528823168 00010000:00010000:1.0:1788864911.936507:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959c39 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd25 expref: 42 pid: 6705 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864911.936566:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:1.0:1788864911.936578:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1e51050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+42:2358:x1875760528823168:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864911.936630:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864911.936640:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959c39 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd25 expref: 42 pid: 6705 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.936656:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959c39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd25 expref: 42 pid: 6705 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.936689:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:1.0:1788864911.936696:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c6a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.936747:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.936758:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c6a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864911.936790:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864911.936862:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1e51050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+42:2358:x1875760528823168:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 286us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864911.936870:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00010000:00010000:2.0:1788864911.937532:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959c39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd25 expref: 41 pid: 6705 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864911.937572:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0555180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875760546651008:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788864911.937605:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.937624:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.937631:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864911.937656:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788864911.937912:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959c63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd33 expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.937932:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd33 expref: 41 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.937944:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:2.0:1788864911.937948:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788864911.937951:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385a00, rc 0) 00000100:00100000:2.0:1788864911.938017:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+41:11442:x1875760528823040:12345-192.168.203.13@tcp:101:dd.0 Request processed in 6712us (6950us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788864911.938024:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 153 00010000:00010000:2.0:1788864911.941581:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864911.944506:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864911.944689:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528823424 00000100:00100000:2.0:1788864911.944727:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528823424 00000100:00100000:2.0:1788864911.947944:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 154 00000100:00100000:2.0:1788864911.948152:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+41:11442:x1875760528823424:12345-192.168.203.13@tcp:36:dd.0 00010000:00010000:2.0:1788864911.949030:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.949056:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.949074:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788864911.949963:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788864911.950814:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d11be12f reply state 00000000ffc6fd62 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864911.950830:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788864911.951026:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+44:11442:x1875760528823424:12345-192.168.203.13@tcp:36:dd.0 Request processed in 2864us (6519us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788864911.951037:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 154 00000020:00080000:2.0:1788864911.951046:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788864911.954768:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.954793:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c78 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.954804:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.954811:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864911.954817:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.954855:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c78 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.954889:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:2.0:1788864911.954893:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864911.954900:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c78 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864911.954908:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959c78 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788864912.197288:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788864912.197302:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788864912.197591:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1788864912.197598:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788864912.280489:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864912.281135:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528823552 00000100:00100000:1.0:1788864912.281150:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528823552 00000100:00100000:1.0:1788864912.281242:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 155 00000100:00100000:1.0:1788864912.281255:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+43:11456:x1875760528823552:12345-192.168.203.13@tcp:101:stat.0 00010000:00010000:1.0:1788864912.281289:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864912.281317:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959c7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fd3a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.281447:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959c86 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.281464:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959c86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.281479:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959c86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.281497:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959c8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.281504:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.281510:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.281618:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959c94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.281630:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c6a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd33 expref: 44 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.281640:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959c94 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.281685:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd33 expref: 44 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.281757:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c6a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd33 expref: 44 pid: 5837 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864912.281785:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcafcbb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875760546651136:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788864912.281929:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc90902780 going to sleep for 11 seconds 00000100:00080000:0.0:1788864912.282353:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788864912.284879:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864912.285013:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcafcbb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875760546651136:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788864912.285063:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959c94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864912.285240:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528823808 00000100:00100000:2.0:1788864912.285249:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528823808 00000100:00100000:2.0:1788864912.285318:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:2.0:1788864912.285330:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+45:5594:x1875760528823808:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788864912.285810:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+46:5594:x1875760528823808:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 479us (957us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788864912.285819:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:2.0:1788864912.288170:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864912.288589:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528823936 00000100:00100000:1.0:1788864912.288613:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528823936 00010000:00010000:1.0:1788864912.288672:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c6a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd33 expref: 46 pid: 5837 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864912.288755:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:1.0:1788864912.288776:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0555180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+46:2359:x1875760528823936:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864912.288797:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864912.288806:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c6a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd33 expref: 46 pid: 5837 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.288821:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd33 expref: 46 pid: 5837 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.288848:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959c6a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd33 expref: 46 pid: 5837 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.289569:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:1.0:1788864912.289579:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959c94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.289615:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.289625:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959c94 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.289675:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864912.289817:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0555180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+45:2359:x1875760528823936:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 1042us (1658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864912.289827:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 65 00010000:00010000:0.0:1788864912.290625:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.290639:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864912.290749:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788864912.290754:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788864912.290793:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.290811:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.290824:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959c86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.290831:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959c86 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.290838:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959c86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.290845:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864912.290850:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959c86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.291297:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959c86 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.291316:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:0.0:1788864912.291336:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864912.291343:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959c86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.291349:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959c86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.291367:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.291373:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959c8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.291540:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959c8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.291546:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864912.291550:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959c8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.291556:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959c8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.291565:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fdc8328ed00) 00010000:00010000:0.0:1788864912.291568:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864912.291571:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959c8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.291577:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959c8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.291638:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959c7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd3a expref: 45 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.291669:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959c94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd3a expref: 44 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.291678:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:0.0:1788864912.291680:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788864912.291683:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc75000, rc 0) 00000100:00100000:0.0:1788864912.292127:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+44:11456:x1875760528823552:12345-192.168.203.13@tcp:101:stat.0 Request processed in 10873us (11653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864912.292137:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 155 00000100:00100000:0.0:1788864912.367091:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864912.370130:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528824192 00000100:00100000:3.0:1788864912.370152:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528824192 00000100:00100000:3.0:1788864912.370263:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 156 00000100:00100000:3.0:1788864912.370276:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+44:11462:x1875760528824192:12345-192.168.203.13@tcp:36:truncate.0 00010000:00010000:3.0:1788864912.370358:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864912.370396:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959c94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd3a expref: 44 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864912.370419:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:3.0:1788864912.370425:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788864912.370870:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959c9b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864912.370899:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959c9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864912.370930:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959c9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788864912.370992:0:6705:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1788864912.371019:0:6705:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005581ddb5 reply state 000000009cd70480 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959c9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864912.371030:0:6705:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788864912.371217:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+46:11462:x1875760528824192:12345-192.168.203.13@tcp:36:truncate.0 Request processed in 941us (4140us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788864912.371226:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 156 00000020:00080000:3.0:1788864912.371232:0:6705:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788864912.385243:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959c9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.385334:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959c9b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.385352:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959c9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.385359:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213ec00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864912.385364:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959c9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.385375:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959c9b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.385394:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:1.0:1788864912.385397:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864912.385402:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959c9b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.385431:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959c9b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864912.570009:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864912.570110:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528824320 00000100:00100000:2.0:1788864912.570126:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528824320 00000100:00100000:2.0:1788864912.570212:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 157 00000100:00100000:2.0:1788864912.570223:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+45:11476:x1875760528824320:12345-192.168.203.13@tcp:101:stat.0 00010000:00010000:2.0:1788864912.570256:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864912.570284:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959ca2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fd41 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.570394:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e959ca9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.570411:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e959ca9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.570425:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e959ca9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.570442:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959cb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.570450:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.570457:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.570568:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959cb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.570577:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.570584:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864912.572038:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788864912.572050:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788864912.572099:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.572141:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.572155:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e959ca9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.572163:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e959ca9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.572447:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e959ca9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.572455:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864912.572460:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e959ca9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.572470:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e959ca9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.572488:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:2.0:1788864912.572492:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864912.572498:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e959ca9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.572505:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e959ca9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.572524:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.572531:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959cb0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.572547:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.572552:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864912.572555:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.572562:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959cb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.572570:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fdc9124e700) 00010000:00010000:2.0:1788864912.572572:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864912.572575:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959cb0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.572581:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959cb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.575048:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e959ca2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd41 expref: 47 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.575088:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd41 expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864912.575098:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:2.0:1788864912.575100:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788864912.575105:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385000, rc 0) 00000100:00100000:2.0:1788864912.575212:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+46:11476:x1875760528824320:12345-192.168.203.13@tcp:101:stat.0 Request processed in 4989us (5212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864912.575243:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 157 00000100:00100000:2.0:1788864912.691131:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864912.691522:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528824576 00000100:00100000:0.0:1788864912.691534:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528824576 00000100:00100000:0.0:1788864912.691615:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 158 00000100:00100000:0.0:1788864912.691637:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+46:11486:x1875760528824576:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788864912.691663:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864912.691689:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959cbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fd48 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864912.691847:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788864912.692016:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959cbe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd48 expref: 48 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.692034:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc834b8000) 00010000:00010000:0.0:1788864912.692037:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788864912.692062:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959cbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd48 expref: 48 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.692081:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4be00, rc 0) 00000100:00100000:0.0:1788864912.692579:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+47:11486:x1875760528824576:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 942us (1461us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1788864912.692589:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 158 00000100:00100000:3.0:1788864912.696291:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864912.698783:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528824832 00000100:00100000:2.0:1788864912.698806:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528824832 00000100:00100000:2.0:1788864912.698909:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:2.0:1788864912.698923:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca21f7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+47:11486:x1875760528824832:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788864912.699244:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca21f7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+48:11486:x1875760528824832:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 323us (2966us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788864912.699254:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:0.0:1788864912.709436:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcafcbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546651264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788864912.709550:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864912.709963:0:10234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546651264 00000100:00100000:2.0:1788864912.709975:0:10234:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546651264 00000100:00100000:2.0:1788864912.710069:0:10234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788864912.710094:0:10234:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546651264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788864912.710141:0:10234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788864912.710209:0:10234:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546651264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864912.710218:0:10234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788864912.710284:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcafcbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546651264:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788864912.713199:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788864912.764482:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1788864912.764511:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:2.0:1788864912.773831:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864912.773937:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528825088 00000100:00100000:0.0:1788864912.773951:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528825088 00000100:00100000:0.0:1788864912.774031:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 159 00000100:00100000:0.0:1788864912.774043:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+48:11492:x1875760528825088:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788864912.774076:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864912.774103:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959ccc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fd4f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.774245:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959cd3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.774262:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959cb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd41 expref: 49 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.774272:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959cd3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.774317:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd41 expref: 49 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.774364:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959cb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd41 expref: 49 pid: 5837 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864912.774381:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc00eb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875760546651392:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788864912.774513:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788864912.780777:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc00eb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875760546651392:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788864912.780821:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959cd3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864912.784595:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864912.784845:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528825216 00000100:00100000:3.0:1788864912.784859:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528825216 00010000:00010000:3.0:1788864912.784925:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959cb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd41 expref: 50 pid: 5837 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864912.784972:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:3.0:1788864912.784986:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0556d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+50:2359:x1875760528825216:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788864912.785005:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864912.785013:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959cb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd41 expref: 50 pid: 5837 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864912.785028:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd41 expref: 50 pid: 5837 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864912.785083:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959cb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd41 expref: 50 pid: 5837 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864912.785102:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:3.0:1788864912.785109:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959cd3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864912.785120:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959cd3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864912.785128:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959cd3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864912.785160:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788864912.785241:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0556d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+49:2359:x1875760528825216:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 259us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864912.785250:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 66 00010000:00010000:1.0:1788864912.786203:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959cd3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.786216:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959cd3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864912.786241:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788864912.788007:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959ccc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd4f expref: 50 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.788044:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959cd3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd4f expref: 49 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.788056:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:0.0:1788864912.788059:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788864912.788064:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4b600, rc 0) 00000100:00100000:0.0:1788864912.788225:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+49:11492:x1875760528825088:12345-192.168.203.13@tcp:101:bash.0 Request processed in 14117us (14341us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1788864912.788237:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 159 00000100:00100000:2.0:1788864912.794966:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864912.796521:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528825472 00000100:00100000:3.0:1788864912.796541:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528825472 00000100:00100000:3.0:1788864912.796683:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 160 00000100:00100000:3.0:1788864912.796697:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+49:11492:x1875760528825472:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:3.0:1788864912.797115:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e959ce1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864912.797137:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e959ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864912.797150:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e959ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788864912.797237:0:6705:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1788864912.797266:0:6705:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000563eeb5 reply state 0000000086fa1aed transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e959ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864912.797276:0:6705:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788864912.799231:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+52:11492:x1875760528825472:12345-192.168.203.13@tcp:36:bash.0 Request processed in 2522us (4263us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788864912.799246:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 160 00000020:00080000:3.0:1788864912.799255:0:6705:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788864912.801544:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e959ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.801569:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e959ce1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.801578:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e959ce1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.801584:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213e400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864912.801590:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e959ce1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.801598:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e959ce1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.801619:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:1.0:1788864912.801642:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864912.801650:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e959ce1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.801657:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e959ce1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864912.810892:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864912.812174:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528825600 00000100:00100000:1.0:1788864912.812192:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528825600 00000100:00100000:0.0:1788864912.812401:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 161 00000100:00100000:0.0:1788864912.812416:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+51:11492:x1875760528825600:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788864912.812454:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864912.812482:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959ce8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fd56 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.812593:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959cef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.812634:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959cd3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd4f expref: 52 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.812644:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959cef lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.812724:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959cd3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd4f expref: 52 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.812740:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959cd3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd4f expref: 52 pid: 5836 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864912.812756:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc00e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875760546651520:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788864912.812881:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598300 going to sleep for 11 seconds 00000100:00100000:0.0:1788864912.815069:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc00e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875760546651520:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788864912.815104:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959cef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864912.815934:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864912.815992:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528825728 00000100:00100000:1.0:1788864912.816003:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528825728 00010000:00010000:1.0:1788864912.816054:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959cd3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd4f expref: 53 pid: 5836 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864912.816156:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:1.0:1788864912.816169:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0554700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+53:2358:x1875760528825728:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864912.816187:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864912.816195:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959cd3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd4f expref: 53 pid: 5836 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.816210:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959cd3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd4f expref: 53 pid: 5836 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.816237:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959cd3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd4f expref: 53 pid: 5836 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.816256:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:1.0:1788864912.816263:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959cef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.816308:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.816317:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959cef lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.816372:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864912.816457:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0554700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+52:2358:x1875760528825728:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 290us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864912.816465:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 67 00010000:00010000:0.0:1788864912.816686:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.816694:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864912.817236:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788864912.817244:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788864912.817273:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.817341:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959ce8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd56 expref: 52 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.817363:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959cef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd56 expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.817372:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:0.0:1788864912.817385:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788864912.817390:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4ae00, rc 0) 00000100:00100000:0.0:1788864912.817495:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+51:11492:x1875760528825600:12345-192.168.203.13@tcp:101:bash.0 Request processed in 5083us (6627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864912.817504:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 161 00000100:00100000:2.0:1788864912.821142:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864912.821477:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528825984 00000100:00100000:3.0:1788864912.821492:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528825984 00000100:00100000:3.0:1788864912.821616:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:3.0:1788864912.821629:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+51:11492:x1875760528825984:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:3.0:1788864912.822156:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+52:11492:x1875760528825984:12345-192.168.203.13@tcp:35:bash.0 Request processed in 527us (1027us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1788864912.822165:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:2.0:1788864912.911115:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864912.911254:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528826240 00000100:00100000:0.0:1788864912.911279:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528826240 00000100:00100000:0.0:1788864912.911364:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 162 00000100:00100000:0.0:1788864912.911387:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+52:11502:x1875760528826240:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788864912.911421:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864912.911450:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959cf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fd5d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864912.911928:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788864912.912106:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959cf6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd5d expref: 54 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.912125:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc834b8000) 00010000:00010000:0.0:1788864912.912129:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788864912.912145:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959cf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd5d expref: 54 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.912163:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4a800, rc 0) 00000100:00100000:0.0:1788864912.912245:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+53:11502:x1875760528826240:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 871us (1144us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1788864912.912254:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 162 00000100:00100000:2.0:1788864912.923141:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864912.923273:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528826368 00000100:00100000:0.0:1788864912.923287:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528826368 00000100:00100000:0.0:1788864912.923364:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 163 00000100:00100000:0.0:1788864912.923377:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+53:11502:x1875760528826368:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:0.0:1788864912.923484:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959d04 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.923507:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959d04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.923523:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959d04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.923541:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.923549:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.923557:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.923670:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959d12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.923700:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.923756:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788864912.923813:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.924017:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959d04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.924027:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959d04 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.924035:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959d04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.924041:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864912.924047:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959d04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.924055:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959d04 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.924070:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:0.0:1788864912.924074:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864912.924080:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959d04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.924087:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959d04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.924113:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.924121:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.924126:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.924131:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864912.924134:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.924140:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.924147:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fdca4f57100) 00010000:00010000:0.0:1788864912.924150:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864912.924153:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.924159:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.924175:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.924182:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959d12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.924188:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.924200:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864912.924204:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.924210:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959d12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.924219:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:0.0:1788864912.924222:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864912.924226:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959d12 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.924232:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959d12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864912.924373:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+53:11502:x1875760528826368:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 997us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864912.924383:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 163 00000100:00100000:2.0:1788864912.931556:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864912.933205:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528826624 00000100:00100000:0.0:1788864912.933224:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528826624 00000100:00100000:0.0:1788864912.933392:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:0.0:1788864912.933407:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+53:11502:x1875760528826624:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1788864912.933942:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+54:11502:x1875760528826624:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 536us (2399us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788864912.933951:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00010000:00010000:1.0:1788864912.967740:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864912.980771:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864912.980907:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528826880 00000100:00100000:0.0:1788864912.980922:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528826880 00000100:00100000:0.0:1788864912.981000:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 164 00000100:00100000:0.0:1788864912.981033:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+54:11505:x1875760528826880:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788864912.981069:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864912.981097:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959d19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fd64 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.981200:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d20 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.981218:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.981233:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.981254:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959d27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.981262:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959d27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.981269:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959d27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.981469:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959d2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.981480:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959d2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.981489:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959d2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864912.981515:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788864912.981666:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.981676:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d20 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.981684:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.981691:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864912.981697:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.981760:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d20 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.981775:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:0.0:1788864912.981779:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864912.981784:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.981791:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.981808:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959d27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.981814:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959d27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.981831:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959d27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.981837:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864912.981840:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959d27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.981846:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959d27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.981854:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fdca4f57100) 00010000:00010000:0.0:1788864912.981857:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864912.981860:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959d27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.981866:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959d27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.981938:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959d19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd64 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.981954:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959d2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd64 expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.981961:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:0.0:1788864912.981964:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788864912.981967:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4b600, rc 0) 00000100:00100000:0.0:1788864912.982066:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+56:11505:x1875760528826880:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1036us (1381us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788864912.982084:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 164 00000100:00100000:2.0:1788864912.989088:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864912.989213:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528827008 00000100:00100000:0.0:1788864912.989227:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528827008 00000100:00100000:0.0:1788864912.989304:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 165 00000100:00100000:0.0:1788864912.989318:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+56:11505:x1875760528827008:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:0.0:1788864912.989418:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959d3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.989439:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.989454:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.989493:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.989501:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959d3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.989510:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959d3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.989517:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864912.989523:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959d3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.989534:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959d3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.989548:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:0.0:1788864912.989571:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788864912.989578:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959d3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864912.989586:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959d3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864912.989692:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+56:11505:x1875760528827008:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 376us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864912.989701:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 165 00000100:00100000:2.0:1788864912.994837:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864912.995060:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528827136 00000100:00100000:1.0:1788864912.995075:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528827136 00000100:00100000:1.0:1788864912.995166:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:1.0:1788864912.995180:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0557800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+56:2358:x1875760528827136:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864912.995199:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864912.995231:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e959d2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd64 expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864912.995254:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:1.0:1788864912.995261:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864912.995341:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0557800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+55:2358:x1875760528827136:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 164us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864912.995349:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1788864912.999027:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864912.999136:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528827392 00000100:00100000:2.0:1788864912.999151:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528827392 00000100:00100000:2.0:1788864912.999225:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:2.0:1788864912.999237:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+55:11505:x1875760528827392:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788864913.000021:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+56:11505:x1875760528827392:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 779us (1002us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788864913.000032:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:2.0:1788864913.148281:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864913.148457:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528827648 00000100:00100000:0.0:1788864913.148470:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528827648 00000100:00100000:0.0:1788864913.148552:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 166 00000100:00100000:0.0:1788864913.148565:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+56:11523:x1875760528827648:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:0.0:1788864913.148599:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864913.148628:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959d43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fd6b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.148816:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d4a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.148834:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.148849:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864913.148864:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788864913.149050:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959d43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd6b expref: 59 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.149100:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd6b expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.149110:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:0.0:1788864913.149113:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788864913.149118:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4a400, rc 0) 00000100:00100000:0.0:1788864913.149206:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+58:11523:x1875760528827648:12345-192.168.203.13@tcp:101:cat.0 Request processed in 643us (948us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788864913.149214:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 166 00000100:00100000:0.0:1788864913.194988:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864913.197156:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528827776 00000100:00100000:2.0:1788864913.197176:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528827776 00000100:00100000:2.0:1788864913.197277:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 167 00000100:00100000:2.0:1788864913.197290:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+58:11524:x1875760528827776:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788864913.197323:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864913.197352:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959d58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fd72 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.197584:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959d5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.197601:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959d5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.197616:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959d5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864913.197682:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788864913.197687:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788864913.197731:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959d5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.197766:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959d58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd72 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.197788:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959d5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd72 expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.197797:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:2.0:1788864913.197800:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788864913.197804:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384600, rc 0) 00000100:00100000:2.0:1788864913.197905:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+59:11524:x1875760528827776:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 618us (2933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864913.197913:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 167 00000100:00100000:2.0:1788864913.202474:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864913.202761:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528828160 00000100:00100000:0.0:1788864913.202775:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528828160 00000100:00100000:0.0:1788864913.202841:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:0.0:1788864913.202855:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+59:11524:x1875760528828160:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1788864913.203303:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+60:11524:x1875760528828160:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 448us (855us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788864913.203311:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:1.0:1788864913.207125:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864913.210845:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528828288 00000100:00100000:0.0:1788864913.210884:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528828288 00000100:00100000:0.0:1788864913.211061:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:0.0:1788864913.211074:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+60:11524:x1875760528828288:12345-192.168.203.13@tcp:103:lfs.0 00010000:00010000:0.0:1788864913.211095:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788864913.211130:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959cef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd56 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.211181:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd6b expref: 59 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.211194:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959bfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd17 expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.211206:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:0.0:1788864913.211220:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864913.211304:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+57:11524:x1875760528828288:12345-192.168.203.13@tcp:103:lfs.0 Request processed in 233us (4193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864913.211312:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:2.0:1788864913.216168:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864913.216297:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528828416 00000100:00100000:3.0:1788864913.216317:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528828416 00000100:00100000:3.0:1788864913.216402:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 168 00000100:00100000:3.0:1788864913.216415:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+57:11524:x1875760528828416:12345-192.168.203.13@tcp:58:lfs.0 00010000:00010000:3.0:1788864913.216769:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959d66 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.216791:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959d66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.216818:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959d66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788864913.217095:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788864913.217199:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+57:11524:x1875760528828416:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 784us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864913.217209:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 168 00000040:00080000:0.0:1788864913.221062:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788864913.221076:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788864913.221120:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788864913.221129:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788864913.221294:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc00ead80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1875760546651648:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788864913.221429:0:11671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598240 going to sleep for 11 seconds 00000100:00100000:0.0:1788864913.226993:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc00ead80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1875760546651648:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788864913.228258:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864913.228381:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528828544 00000100:00100000:0.0:1788864913.228394:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528828544 00000100:00100000:0.0:1788864913.228478:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 169 00000100:00100000:0.0:1788864913.228490:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+57:11525:x1875760528828544:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788864913.228532:0:5836:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788864913.228681:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+57:11525:x1875760528828544:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 193us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864913.228729:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 169 00000100:00100000:2.0:1788864913.239272:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864913.239499:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528828672 00000100:00100000:3.0:1788864913.239513:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528828672 00000100:00100000:3.0:1788864913.239591:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 170 00000100:00100000:3.0:1788864913.239604:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+57:11525:x1875760528828672:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788864913.240229:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959d6d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.240255:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959d6d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.240274:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959d6d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.240299:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959d74 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.240307:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959d74 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.240314:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959d74 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.240351:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959d7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.240394:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959d7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.240402:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959d7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788864913.240458:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788864913.240587:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788864913.240606:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959d7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.240622:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959d6d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.240631:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959d6d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.240639:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959d6d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.240646:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213ec00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864913.240652:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959d6d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.240661:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959d6d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.240676:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fdca4f57c00) 00010000:00010000:3.0:1788864913.240679:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864913.240685:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959d6d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.240816:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959d6d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.240940:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959d74 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.240947:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959d74 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.240953:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959d74 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.240958:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213ea00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864913.240962:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959d74 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.240969:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959d74 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.240978:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9fdc834b8e00) 00010000:00010000:3.0:1788864913.240981:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864913.240984:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959d74 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.240989:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959d74 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.241006:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959d7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.241013:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959d7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.241026:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959d7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.241030:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213e600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864913.241033:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959d7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.241040:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959d7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.241048:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc834b8500) 00010000:00010000:3.0:1788864913.241050:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864913.241053:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959d7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.241059:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959d7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864913.241240:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+57:11525:x1875760528828672:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 1634us (1980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864913.241251:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 170 00000100:00100000:3.0:1788864913.258987:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864913.259120:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528828928 00000100:00100000:0.0:1788864913.259136:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528828928 00000100:00100000:0.0:1788864913.259212:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 171 00000100:00100000:0.0:1788864913.259224:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+57:11525:x1875760528828928:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788864913.259251:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864913.259279:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d82 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fd79 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.259421:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959d89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.259442:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.259458:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864913.259895:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788864913.260035:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.260045:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959d89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.260053:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959d89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.260060:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4ae00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864913.260066:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959d89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.260091:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959d89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.260109:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc834b8500) 00010000:00010000:0.0:1788864913.260112:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788864913.260119:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959d89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.260126:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959d89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.260189:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d82 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd79 expref: 59 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.260201:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fdca4f57c00) 00010000:00010000:0.0:1788864913.260203:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788864913.260207:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e959d82 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd79 expref: 59 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.260217:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4a400, rc 0) 00000100:00100000:0.0:1788864913.260361:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+58:11525:x1875760528828928:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1138us (1388us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1788864913.260377:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 171 00000100:00100000:1.0:1788864913.269184:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864913.269367:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528829056 00000100:00100000:2.0:1788864913.269380:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528829056 00000100:00100000:2.0:1788864913.269451:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 172 00000100:00100000:2.0:1788864913.269472:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+58:11527:x1875760528829056:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788864913.269505:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864913.269533:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959d97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fd80 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.269636:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959d9e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.269653:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959d9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.269666:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959d9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.269682:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959da5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.269688:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.269695:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.269855:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959dac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.269874:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.269882:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864913.269931:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788864913.269936:0:6705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788864913.269960:0:6705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.269983:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.269992:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959d9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.269999:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959d9e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.270006:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959d9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.270013:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864913.270019:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959d9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.270027:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959d9e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.270041:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:2.0:1788864913.270044:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864913.270050:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959d9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.270057:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959d9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.270073:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.270079:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959da5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.270092:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959da5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.270098:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864913.270101:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959da5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.270108:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959da5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.270116:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fdc9124e700) 00010000:00010000:2.0:1788864913.270119:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864913.270122:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959da5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.270128:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959da5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.270167:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959d97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd80 expref: 60 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.270182:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959dac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd80 expref: 59 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.270190:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc834b8500) 00010000:00010000:2.0:1788864913.270192:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788864913.270195:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384000, rc 0) 00000100:00100000:2.0:1788864913.270270:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+59:11527:x1875760528829056:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 809us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864913.270290:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 172 00000100:00100000:2.0:1788864913.274096:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864913.274176:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528829184 00000100:00100000:0.0:1788864913.274191:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528829184 00000100:00100000:0.0:1788864913.274269:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 173 00000100:00100000:0.0:1788864913.274283:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9080ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+59:11525:x1875760528829184:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788864913.274353:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788864913.275763:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9080ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+59:11525:x1875760528829184:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 1470us (1669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864913.275779:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 173 00000100:00100000:1.0:1788864913.280450:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864913.280979:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528829440 00000100:00100000:2.0:1788864913.280992:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528829440 00000100:00100000:2.0:1788864913.281076:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 174 00000100:00100000:2.0:1788864913.281088:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+59:11525:x1875760528829440:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788864913.281115:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864913.281118:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788864913.281152:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959d5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd72 expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.281177:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:2.0:1788864913.281183:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788864913.281199:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959db3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fd87 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788864913.281811:0:6705:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788864913.282307:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959dba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.282325:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.282338:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.282411:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959db3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd87 expref: 61 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.282458:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959dba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd87 expref: 60 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.286113:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fdc9124e700) 00010000:00010000:2.0:1788864913.286117:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788864913.286122:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385800, rc 0) 00000100:00100000:2.0:1788864913.286237:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+60:11525:x1875760528829440:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 5145us (5807us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788864913.286248:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 174 00000100:00100000:1.0:1788864913.299604:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864913.299817:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528829696 00000100:00100000:2.0:1788864913.299841:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528829696 00000100:00100000:2.0:1788864913.299933:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 175 00000100:00100000:2.0:1788864913.299946:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+60:11525:x1875760528829696:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788864913.300045:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864913.300081:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959dba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd87 expref: 60 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.300106:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fdc9124e700) 00010000:00010000:2.0:1788864913.300120:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788864913.300148:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959dc8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.300164:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959dc8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.300176:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959dc8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.300326:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959dcf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x76991d21 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.300355:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959dcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x76991d21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.300369:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959dcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x76991d21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.300630:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959dc8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.300639:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959dc8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.300646:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959dc8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.300652:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864913.300656:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959dc8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.300662:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959dc8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.300673:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:2.0:1788864913.300676:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864913.300682:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959dc8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.300688:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959dc8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.300995:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959dcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x76991d21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.301000:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959dcf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x76991d21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.301006:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959dcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x76991d21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.301012:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864913.301015:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959dcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x76991d21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.301022:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959dcf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x76991d21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.301030:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x76991d21 (ffff9fdc9124ea00) 00010000:00010000:2.0:1788864913.301033:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864913.301037:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959dcf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x76991d21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.301042:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959dcf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x76991d21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864913.301428:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+59:11525:x1875760528829696:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 1476us (1829us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788864913.301441:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 175 00000100:00100000:1.0:1788864913.312180:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864913.313637:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528829824 00000100:00100000:3.0:1788864913.313656:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528829824 00000100:00100000:3.0:1788864913.313942:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 176 00000100:00100000:3.0:1788864913.313955:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+59:11525:x1875760528829824:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788864913.314001:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864913.314032:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959dd6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fd8e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.314075:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959ddd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.314090:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959ddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.314104:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959ddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.314227:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959dd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd8e expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.314252:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959ddd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd8e expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.314262:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fdc834b8e00) 00010000:00010000:3.0:1788864913.314265:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788864913.314269:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213ea00, rc 0) 00000100:00100000:3.0:1788864913.314355:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+60:11525:x1875760528829824:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 403us (2185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864913.314363:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 176 00000100:00100000:1.0:1788864913.319820:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864913.325610:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528830080 00000100:00100000:2.0:1788864913.325634:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528830080 00000100:00100000:2.0:1788864913.325760:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 177 00000100:00100000:2.0:1788864913.325774:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+60:11525:x1875760528830080:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788864913.325897:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959de4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.325938:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.325953:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788864913.326322:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1788864913.326335:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 336457630785ns, next at 337457626907ns, rc = 0 00000004:00010000:2.0:1788864913.326449:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070f555fd reply state 00000000f91a31c4 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864913.326461:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788864913.326609:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+62:11525:x1875760528830080:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 836us (6796us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1788864913.326618:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 177 00010000:00010000:2.0:1788864913.339299:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.339323:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959de4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.339332:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959de4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.339339:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864913.339346:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959de4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.339354:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959de4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.339415:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fdc834b8e00) 00010000:00010000:2.0:1788864913.339419:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788864913.339426:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959de4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.339432:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959de4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864913.340202:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864913.340511:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528830208 00000100:00100000:2.0:1788864913.340526:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528830208 00000100:00100000:2.0:1788864913.340607:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 178 00000100:00100000:2.0:1788864913.340630:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+61:11525:x1875760528830208:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788864913.340665:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864913.340688:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959deb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fd95 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.340811:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959deb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd95 expref: 62 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.340839:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959deb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd95 expref: 62 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.340862:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fdc834b8e00) 00010000:00010000:2.0:1788864913.340874:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788864913.340877:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385e00, rc 0) 00000100:00100000:2.0:1788864913.340952:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+62:11525:x1875760528830208:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 324us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864913.340978:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 178 00000100:00100000:1.0:1788864913.345208:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864913.345327:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528830336 00000100:00100000:3.0:1788864913.345341:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528830336 00000100:00100000:3.0:1788864913.345444:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:3.0:1788864913.345457:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2358:x1875760528830336:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788864913.346260:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2358:x1875760528830336:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 801us (1061us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788864913.346271:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00080000:0.0:1788864913.350588:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788864913.352766:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864913.352890:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528830592 00000100:00100000:0.0:1788864913.352903:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528830592 00000100:00100000:0.0:1788864913.352978:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:0.0:1788864913.352990:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+62:11525:x1875760528830592:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788864913.353310:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+63:11525:x1875760528830592:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 321us (557us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788864913.353319:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:1.0:1788864913.355297:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864913.355425:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528830848 00000100:00100000:2.0:1788864913.355437:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528830848 00000100:00100000:2.0:1788864913.355511:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 179 00000100:00100000:2.0:1788864913.355523:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+63:11525:x1875760528830848:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788864913.355665:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+63:11525:x1875760528830848:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 143us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864913.355673:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 179 00000100:00100000:1.0:1788864913.358194:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864913.358574:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528830976 00000100:00100000:2.0:1788864913.358585:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528830976 00000100:00100000:2.0:1788864913.358656:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 180 00000100:00100000:2.0:1788864913.358667:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+63:11525:x1875760528830976:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788864913.358694:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864913.358754:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959df2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fd9c expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.358852:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959df9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.358877:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.358891:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864913.358938:0:6705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788864913.358958:0:6705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.359008:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959df2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd9c expref: 65 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.359029:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959df9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd9c expref: 64 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.359038:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fdc834b8e00) 00010000:00010000:2.0:1788864913.359041:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788864913.359046:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385800, rc 0) 00000100:00100000:2.0:1788864913.359119:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+64:11525:x1875760528830976:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 453us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864913.359127:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 180 00000100:00100000:1.0:1788864913.364848:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864913.364933:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528831104 00000100:00100000:3.0:1788864913.364946:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528831104 00000100:00100000:3.0:1788864913.365011:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:3.0:1788864913.365023:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2359:x1875760528831104:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788864913.365048:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864913.365075:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6341c81/0xf8c13e2d0e959e00 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fda3 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788864913.365115:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fe990, blocks: 0x1 00010000:00010000:3.0:1788864913.365141:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=336s v=(0 0) 00010000:00010000:3.0:1788864913.365146:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788864913.365158:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6341c81/0xf8c13e2d0e959e00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fda3 expref: 8 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.365177:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e6341c81/0xf8c13e2d0e959e00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fda3 expref: 8 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.365192:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213e600, rc 0) 00000100:00100000:3.0:1788864913.365271:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2359:x1875760528831104:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 250us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864913.365279:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:1.0:1788864913.377664:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864913.377888:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528831360 00000100:00100000:2.0:1788864913.377901:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528831360 00000100:00100000:2.0:1788864913.377978:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 181 00000100:00100000:2.0:1788864913.377989:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+64:11525:x1875760528831360:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788864913.378127:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+64:11525:x1875760528831360:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 139us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864913.378136:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 181 00000100:00100000:1.0:1788864913.390765:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864913.392214:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528831488 00000100:00100000:2.0:1788864913.392231:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528831488 00000100:00100000:3.0:1788864913.392382:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:3.0:1788864913.392412:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:11525:x1875760528831488:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788864913.392437:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864913.392461:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959e07 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fdaa expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.392504:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6341c81/0xf8c13e2d0e959e00 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fda3 expref: 9 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.392514:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788864913.392519:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788864913.392526:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959e07 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdaa expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.392570:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e6341c81/0xf8c13e2d0e959e00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fda3 expref: 9 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.392587:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e6341c81/0xf8c13e2d0e959e00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fda3 expref: 9 pid: 6684 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864913.392604:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc07c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6682:1875760546651776:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788864913.392841:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcacbe06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864913.398130:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864913.399567:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc07c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6682:1875760546651776:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788864913.399618:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959e07 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdaa expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.399644:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213ec00, rc 0) 00000100:00100000:0.0:1788864913.399752:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:11525:x1875760528831488:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 7345us (9057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864913.399762:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:0.0:1788864913.400455:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528831616 00000100:00100000:0.0:1788864913.400466:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528831616 00010000:00010000:0.0:1788864913.400516:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e6341c81/0xf8c13e2d0e959e00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fda3 expref: 9 pid: 6684 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864913.400593:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:0.0:1788864913.400603:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:2359:x1875760528831616:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788864913.400621:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864913.400651:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e6341c81/0xf8c13e2d0e959e00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fda3 expref: 9 pid: 6684 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.400666:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e6341c81/0xf8c13e2d0e959e00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fda3 expref: 9 pid: 6684 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.400695:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6341c81/0xf8c13e2d0e959e00 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fda3 expref: 9 pid: 6684 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.401276:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788864913.401283:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788864913.401297:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959e07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdaa expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.401310:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959e07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdaa expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.401363:0:5821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959e07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdaa expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864913.401449:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc00ead80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5821:1875760546651904:192.168.203.13@tcp:105: 00000100:00100000:0.0:1788864913.401574:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598480 going to sleep for 11 seconds 00000100:00100000:2.0:1788864913.416251:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864913.416319:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc00ead80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5821:1875760546651904:192.168.203.13@tcp:105: 00010000:00010000:0.0:1788864913.416349:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864913.416425:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2359:x1875760528831616:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 15822us (18307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864913.416436:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:3.0:1788864913.417626:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528831744 00000100:00100000:3.0:1788864913.417645:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528831744 00002000:00100000:3.0:1788864913.419906:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9fdc9080c000 x1875760528831744/t0(0) o4->1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp:389/0 lens 504/0 e 0 to 0 dl 1788864924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788864913.419924:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fdc9080c000 with x1875760528831744 ext(0->8) 00002000:00010000:3.0:1788864913.419954:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fdc9080c000 00000100:00100000:3.0:1788864913.420025:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:3.0:1788864913.420045:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9080c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2359:x1875760528831744:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788864913.420641:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9080c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+10:2359:x1875760528831744:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 Request processed in 603us (4404us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788864913.420650:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00002000:00100000:3.0:1788864913.420658:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9fdc9080c000 x1875760528831744/t4294967314(0) o4->1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp:389/0 lens 504/448 e 0 to 0 dl 1788864924 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788864913.420668:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fdc9080c000 with x1875760528831744 ext(0->8) 00002000:00010000:3.0:1788864913.420673:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fdc9080c000 00000100:00100000:2.0:1788864913.435050:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864913.435168:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528831872 00000100:00100000:3.0:1788864913.435181:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528831872 00000100:00100000:3.0:1788864913.435250:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 182 00000100:00100000:3.0:1788864913.435260:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcacbeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+64:11525:x1875760528831872:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788864913.516689:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:2.0:1788864913.516782:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fdcc0598180 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788864913.516788:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fdcbff13800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fdcc0598000 00000020:00080000:2.0:1788864913.516807:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fdcbff13d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fdb81190400 00000020:00080000:0.0:1788864913.516856:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000004:00080000:2.0:1788864913.517187:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1788864913.517261:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788864913.517296:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788864913.517809:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546652032:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788864913.517918:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864913.518237:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcacbeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+29:11525:x1875760528831872:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 82971us (83189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864913.518250:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 182 00000100:00100000:3.0:1788864913.518417:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546652032 00000100:00100000:3.0:1788864913.518426:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546652032 00000100:00100000:3.0:1788864913.518481:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788864913.518492:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546652032:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788864913.518674:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788864913.518679:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788864913 00002000:00010000:3.0:1788864913.518682:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788864913.518684:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788864912 -> 1788864913 00002000:00010000:3.0:1788864913.518696:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788864913.518994:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1875760546652032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 504us (1078us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788864913.519005:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788864913.519045:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc07c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546652160:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788864913.519087:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864913.519154:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546652160 00000100:00100000:3.0:1788864913.519160:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546652160 00000100:00100000:3.0:1788864913.519215:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788864913.519223:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc07c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546652160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788864913.519243:0:8199:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1788864913.519278:0:8199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9fe98e, atime: 0x6a9fe98e, ctime: 0x6a9fe98e, blocks: 0xb 00010000:00010000:3.0:1788864913.519288:0:8199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6341c81/0xf8c13e2d0e959e0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.519306:0:8199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=336s v=(0 0) 00010000:00010000:3.0:1788864913.519311:0:8199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788864913.519317:0:8199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6341c81/0xf8c13e2d0e959e0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.519335:0:8199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6341c81/0xf8c13e2d0e959e0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.519346:0:8199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6341c81/0xf8c13e2d0e959e0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.519354:0:8199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6341c81/0xf8c13e2d0e959e0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788864913.519541:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788864913.521994:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00010000:00010000:3.0:1788864913.522305:0:8199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788864913.522337:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864913.522348:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6341c81/0xf8c13e2d0e959e0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.522363:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213e600 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788864913.522368:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6341c81/0xf8c13e2d0e959e0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.522380:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6341c81/0xf8c13e2d0e959e0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.522405:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6341c81/0xf8c13e2d0e959e0e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.522413:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6341c81/0xf8c13e2d0e959e0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.522455:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864913.522457:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864913.522459:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864913.523673:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528832000 00000100:00100000:1.0:1788864913.523686:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528832000 00000100:00100000:0.0:1788864913.523938:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:0.0:1788864913.523954:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+10:2359:x1875760528832000:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788864913.525698:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc07c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3301:x1875760546652160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6463us (6599us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788864913.525779:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1788864913.525789:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1788864913.525815:0:3301:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9fdcc07c7b80 x1875760546652160/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788864929 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788864913.525829:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fdcc07c7b80/2, rc 0, transno 4294967307 00000100:00100000:0.0:1788864913.525835:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc07c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546652160:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788864913.526015:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:3.0:1788864913.526138:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fdb81927480/2, rc 0, transno 4294967315 00000100:00100000:3.0:1788864913.526146:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546652032:0@lo:2:osp-syn-0-0.0 00000001:00080000:1.0:1788864913.627449:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:1.0:1788864913.627819:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:3.0:1788864913.628037:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2359:x1875760528832000:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 104080us (106044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864913.628051:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:1.0:1788864913.643896:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864913.644297:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528832256 00000100:00100000:3.0:1788864913.644313:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528832256 00000100:00100000:3.0:1788864913.644402:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 183 00000100:00100000:3.0:1788864913.644418:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+19:11525:x1875760528832256:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788864913.644503:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864913.644539:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959df9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd9c expref: 19 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.644562:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fdc834b8e00) 00010000:00010000:3.0:1788864913.644569:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788864913.644619:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959e15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.644635:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.644646:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788864913.645171:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c296423 reply state 000000004bf2f4bb transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864913.645184:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788864913.645325:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+20:11525:x1875760528832256:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 911us (1441us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788864913.645334:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 183 00010000:00010000:1.0:1788864913.647329:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.647352:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959e15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.647362:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959e15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.647380:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213f800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864913.647403:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959e15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.647412:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959e15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.647435:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fdc834b8e00) 00010000:00010000:1.0:1788864913.647438:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864913.647444:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959e15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.647450:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959e15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864913.649453:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864913.649502:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528832384 00000100:00100000:3.0:1788864913.649515:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528832384 00000100:00100000:3.0:1788864913.649591:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:3.0:1788864913.649603:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2359:x1875760528832384:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788864913.649960:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788864913.649964:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788864913 -> 1788864912 00002000:00010000:3.0:1788864913.649968:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788864910 00002000:00010000:3.0:1788864913.649971:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788864913 -> 1788864912 00002000:00010000:3.0:1788864913.649974:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788864913.650056:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2359:x1875760528832384:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 454us (615us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788864913.650066:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:2.0:1788864913.653351:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864913.662373:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528832640 00000100:00100000:0.0:1788864913.662396:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528832640 00000100:00100000:0.0:1788864913.662490:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 184 00000100:00100000:0.0:1788864913.662502:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+19:11525:x1875760528832640:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788864913.662797:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959e1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.662818:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959ddd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd8e expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.662828:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959e1c lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.662886:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959ddd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd8e expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.662913:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959ddd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd8e expref: 19 pid: 5835 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864913.662931:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc00e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875760546652288:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788864913.663062:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788864913.682413:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864913.682516:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528832768 00000100:00100000:1.0:1788864913.682529:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528832768 00010000:00010000:1.0:1788864913.682582:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959ddd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd8e expref: 20 pid: 5835 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864913.682647:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:1.0:1788864913.682661:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1e53050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+20:2358:x1875760528832768:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864913.682682:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864913.682690:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959ddd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd8e expref: 20 pid: 5835 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.682741:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959ddd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd8e expref: 20 pid: 5835 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.682779:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fdc834b8e00) 00010000:00010000:2.0:1788864913.682785:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959ddd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd8e expref: 20 pid: 5835 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.682807:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959e1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864913.682814:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc00e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875760546652288:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788864913.682823:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959e1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.682847:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959e1c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.683157:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959e1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864913.683159:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788864913.683236:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1e53050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+19:2358:x1875760528832768:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 577us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864913.683246:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00010000:00010000:2.0:1788864913.683782:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959e1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.683791:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959e1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.683829:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959e1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.683837:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959e1c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.683846:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959e1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.683853:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4b000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864913.683859:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959e1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.683899:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959e1c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.683913:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fdc834b8e00) 00010000:00010000:2.0:1788864913.683916:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788864913.683920:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959e1c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.683927:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959e1c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864913.684198:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+18:11525:x1875760528832640:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 Request processed in 21695us (30857us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788864913.684221:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 184 00000100:00100000:0.0:1788864913.690920:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864913.691013:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528832896 00000100:00100000:2.0:1788864913.691027:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528832896 00000100:00100000:2.0:1788864913.691096:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:2.0:1788864913.691109:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2358:x1875760528832896:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788864913.691168:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e959e23 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.691192:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959e07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdaa expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.691202:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864913.691207:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788864913.691212:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e959e23 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.691254:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959e07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdaa expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.691284:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959e07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdaa expref: 8 pid: 6682 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864913.691302:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc858000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6682:1875760546652416:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788864913.691408:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca8d28600 going to sleep for 11 seconds 00000100:00100000:2.0:1788864913.697599:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc858000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6682:1875760546652416:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788864913.697639:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e959e23 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864913.712630:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864913.713023:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528833024 00000100:00100000:1.0:1788864913.713039:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528833024 00010000:00010000:1.0:1788864913.713091:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959e07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdaa expref: 9 pid: 6682 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864913.713147:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:1.0:1788864913.713159:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:2358:x1875760528833024:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864913.713178:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864913.713206:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959e07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdaa expref: 9 pid: 6682 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.713223:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959e07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdaa expref: 9 pid: 6682 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.713252:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f38f230e/0xf8c13e2d0e959e07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdaa expref: 9 pid: 6682 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.713274:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788864913.713278:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788864913.713299:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e959e23 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.713310:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e959e23 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.713360:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864913.713533:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2358:x1875760528833024:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 376us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864913.713541:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 70 00010000:00010000:0.0:1788864913.714685:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e959e23 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.714744:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e959e23 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.714789:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e959e23 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.714798:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e959e23 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.714807:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e959e23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.714815:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384e00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788864913.714821:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e959e23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.714851:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e959e23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.714882:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e959e23 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.714891:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e959e23 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864913.714991:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2358:x1875760528832896:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 23879us (24079us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864913.715002:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:0.0:1788864913.717175:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864913.717404:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528833280 00000100:00100000:1.0:1788864913.717416:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528833280 00000100:00100000:1.0:1788864913.717486:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 185 00000100:00100000:1.0:1788864913.717497:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+18:11525:x1875760528833280:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788864913.717601:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959e2a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.717623:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959e2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.717636:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959e2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.717974:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959e31 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.717987:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959deb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd95 expref: 19 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.717996:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959e31 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.718053:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959deb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd95 expref: 19 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.718068:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959deb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd95 expref: 19 pid: 6705 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864913.718084:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81927b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875760546652544:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788864913.718182:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc90902600 going to sleep for 11 seconds 00000100:00100000:0.0:1788864913.723374:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864913.723462:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528833408 00000100:00100000:2.0:1788864913.723475:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528833408 00010000:00010000:2.0:1788864913.723529:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959deb lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd95 expref: 20 pid: 6705 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864913.723581:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:2.0:1788864913.723593:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+20:2359:x1875760528833408:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788864913.723612:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864913.723620:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959deb lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd95 expref: 20 pid: 6705 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.723635:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959deb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd95 expref: 20 pid: 6705 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.723674:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fdc834b8e00) 00010000:00010000:2.0:1788864913.723691:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959e31 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.723725:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959e31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.723735:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959e31 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.723761:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864913.723824:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+20:2359:x1875760528833408:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 232us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864913.723833:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 71 00010000:00010000:1.0:1788864913.724830:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e959deb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd95 expref: 19 pid: 6705 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864913.724854:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81927b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875760546652544:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788864913.724900:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959e31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.724912:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959e31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.724919:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959e31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788864913.725161:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1788864913.725326:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1788864913.725508:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1788864913.725620:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81927b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5836:1875760546652672:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788864913.725936:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864913.725974:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc90902480 going to sleep for 11 seconds 00000100:00100000:0.0:1788864913.726079:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546652672 00000100:00100000:0.0:1788864913.726087:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546652672 00000100:00100000:0.0:1788864913.726144:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788864913.726155:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1875760546652672:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788864913.726246:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1875760546652672:12345-0@lo:1000:mdt00_001.0 Request processed in 93us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864913.726253:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788864913.726292:0:5836:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1788864913.726297:0:5836:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fdb81927480, transno 4294967315 00000100:00100000:0.0:1788864913.726309:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81927b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5836:1875760546652672:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788864913.726948:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1788864913.727040:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc00ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5836:1875760546652800:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788864913.727085:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864913.727111:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864913.727342:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546652800 00000100:00100000:0.0:1788864913.727349:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546652800 00000100:00100000:0.0:1788864913.727381:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788864913.727389:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1875760546652800:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788864913.727601:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1875760546652800:12345-0@lo:1000:mdt00_001.0 Request processed in 211us (514us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788864913.727609:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788864913.727655:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc00ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5836:1875760546652800:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788864913.727733:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959e31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.727745:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959e31 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.727754:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959e31 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.727760:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864913.727765:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959e31 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.727774:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959e31 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.727792:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fdc834b8e00) 00010000:00010000:0.0:1788864913.727795:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788864913.727808:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959e31 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.727815:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959e31 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.727853:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959d66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.727860:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959d66 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.727879:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959d66 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.727883:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213f600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864913.727886:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959d66 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.727893:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959d66 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.727902:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc834b8500) 00010000:00010000:0.0:1788864913.727905:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788864913.727908:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959d66 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.727914:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959d66 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.727943:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959e38 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.727959:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959dac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd80 expref: 22 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.727974:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959e38 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.728003:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959dac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd80 expref: 22 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864913.728018:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959dac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd80 expref: 22 pid: 6705 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864913.728032:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc00eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875760546652928:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788864913.728104:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864913.730956:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc00eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875760546652928:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788864913.730992:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959e38 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864913.733061:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864913.733249:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528833536 00000100:00100000:1.0:1788864913.733262:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528833536 00010000:00010000:1.0:1788864913.733313:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959dac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd80 expref: 23 pid: 6705 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864913.733454:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:1.0:1788864913.733468:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+23:2359:x1875760528833536:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864913.733488:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864913.733497:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959dac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd80 expref: 23 pid: 6705 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.733513:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959dac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd80 expref: 23 pid: 6705 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.733540:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384000/0xf8c13e2d0e959dac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fd80 expref: 23 pid: 6705 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.733557:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc834b8500) 00010000:00010000:1.0:1788864913.733564:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959e38 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.733575:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959e38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.733584:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959e38 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.733632:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864913.733734:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+22:2359:x1875760528833536:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 239us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864913.733763:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 72 00010000:00010000:2.0:1788864913.733842:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959e38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.733852:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959e38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.733876:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959e38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.733884:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959e38 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.733892:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959e38 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.733911:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4b400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864913.733917:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959e38 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.733925:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959e38 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.733937:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc834b8500) 00010000:00010000:2.0:1788864913.733941:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864913.733946:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959e38 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.733953:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959e38 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.733968:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959e2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.733974:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959e2a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.733979:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959e2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.733983:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864913.733986:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959e2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.733992:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959e2a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.734011:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc834b8500) 00010000:00010000:2.0:1788864913.734014:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788864913.734017:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959e2a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.734023:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959e2a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864913.734291:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+21:11525:x1875760528833280:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 16793us (17126us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1788864913.734302:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 185 00000020:00080000:2.0:1788864913.734306:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788864913.734497:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788864913.734503:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788864913.735054:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788864913.735066:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788864913.735675:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc85b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546653312:0@lo:400:kworker.0 00000100:00100000:2.0:1788864913.735802:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864913.735842:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788864913.735848:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546653440:0@lo:400:kworker.0 00000100:00100000:2.0:1788864913.735884:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864913.736042:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546653056:0@lo:400:kworker.0 00000100:00100000:3.0:1788864913.736083:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864913.736127:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788864913.736131:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546653312 00000100:00100000:3.0:1788864913.736136:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546653184:0@lo:400:kworker.0 00000100:00100000:1.0:1788864913.736143:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546653312 00000100:00100000:3.0:1788864913.736165:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864913.736195:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546653440 00000100:00100000:3.0:1788864913.736201:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546653440 00000100:00100000:1.0:1788864913.736202:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546653184 00000100:00100000:1.0:1788864913.736207:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546653184 00000100:00100000:3.0:1788864913.736239:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00080000:0.0:1788864913.736321:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864913.736365:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc85ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546653312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864913.736432:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc85ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546653312:12345-0@lo:400:kworker.0 Request processed in 184us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864913.736502:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc85b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546653312:0@lo:400:kworker.0 00000100:00100000:2.0:1788864913.736601:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546653056 00000100:00100000:2.0:1788864913.736606:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546653056 00000100:00100000:2.0:1788864913.736643:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788864913.736650:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3302:x1875760546653056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864913.736697:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3302:x1875760546653056:12345-0@lo:400:kworker.0 Request processed in 47us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864913.736736:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788864913.742002:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788864913.742987:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546653440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864913.743126:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546653440:12345-0@lo:400:kworker.0 Request processed in 1108us (7240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864913.743137:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788864913.743181:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788864913.743190:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546653184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864913.743227:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546653184:12345-0@lo:400:kworker.0 Request processed in 40us (7062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864913.743234:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788864913.744607:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546653440:0@lo:400:kworker.0 00000100:00100000:0.0:1788864913.744777:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864913.745494:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528833792 00000100:00100000:1.0:1788864913.745504:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528833792 00000100:00100000:1.0:1788864913.745744:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:1.0:1788864913.745757:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca21f7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+21:11525:x1875760528833792:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788864913.746540:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:3.0:1788864913.747014:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788864913.748095:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546653184:0@lo:400:kworker.0 00000100:00100000:2.0:1788864913.748114:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546653056:0@lo:400:kworker.0 00000001:00080000:1.0:1788864913.748838:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1788864913.748940:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959e3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.748961:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959e3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.748987:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959e3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.748998:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959e3f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.749005:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959e3f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.749012:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959e3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864913.749034:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788864913.749170:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca21f7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+23:11525:x1875760528833792:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 3412us (4392us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788864913.749181:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00010000:00010000:2.0:1788864913.749185:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00080000:1.0:1788864913.749187:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788864913.749195:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959e3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.749205:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75600 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:2.0:1788864913.749210:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959e3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.749220:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959e3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.749236:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fdc8328ee00) 00010000:00010000:2.0:1788864913.749240:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788864913.749245:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959e3f lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.749252:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959e3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864913.749481:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864913.749483:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864913.749485:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864913.991397:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864914.246217:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546653568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788864914.246317:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864914.252671:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546653568 00000100:00100000:3.0:1788864914.252689:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546653568 00000100:00100000:3.0:1788864914.252914:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788864914.252937:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875760546653568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788864914.252992:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788864914.253223:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875760546653568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 298us (6906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864914.253232:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788864914.262949:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546653568:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1788864914.338342:0:12442:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788864914.338354:0:12442:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788864914.338393:0:12442:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788864914.338399:0:12442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788864914.468102:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864914.468151:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528834048 00000100:00100000:1.0:1788864914.468163:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528834048 00000100:00100000:1.0:1788864914.468240:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 186 00000100:00100000:1.0:1788864914.468253:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+23:11548:x1875760528834048:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788864914.468283:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864914.468310:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959e46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fdb1 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.468455:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959e4d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.468473:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959e4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.468486:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959e4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864914.468501:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788864914.468661:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959e46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdb1 expref: 26 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.468681:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959e4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdb1 expref: 25 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.468691:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:1.0:1788864914.468694:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788864914.468699:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc74800, rc 0) 00000100:00100000:1.0:1788864914.468814:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+25:11548:x1875760528834048:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 563us (726us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788864914.468822:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 186 00000100:00080000:1.0:1788864914.468852:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864914.474593:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864914.474806:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528834176 00000100:00100000:2.0:1788864914.474820:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528834176 00000100:00100000:2.0:1788864914.474906:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 187 00000100:00100000:2.0:1788864914.474919:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+25:11548:x1875760528834176:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:2.0:1788864914.475025:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959e5b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475061:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959e5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475077:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959e5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475097:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959e62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475104:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959e62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475111:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959e62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475415:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959e69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475424:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959e69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475432:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959e69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788864914.475492:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959e69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475509:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959e5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475516:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959e5b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475535:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959e5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475542:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864914.475546:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959e5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475556:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959e5b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475571:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:2.0:1788864914.475574:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864914.475580:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959e5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475587:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e959e5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475603:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959e62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475609:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959e62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475614:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959e62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475620:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864914.475623:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959e62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475639:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959e62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475648:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fdc9124ea00) 00010000:00010000:2.0:1788864914.475651:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864914.475654:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959e62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475660:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e959e62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475676:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959e69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475682:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959e69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475687:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959e69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475692:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864914.475695:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959e69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475701:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959e69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475757:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc9124e700) 00010000:00010000:2.0:1788864914.475760:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864914.475763:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959e69 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.475779:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e959e69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864914.475889:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+25:11548:x1875760528834176:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 970us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864914.475899:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 187 00000100:00100000:2.0:1788864914.549100:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864914.549807:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528834432 00000100:00100000:3.0:1788864914.549832:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528834432 00000100:00100000:3.0:1788864914.549918:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 188 00000100:00100000:3.0:1788864914.549930:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+25:11551:x1875760528834432:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788864914.549955:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864914.549982:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959e70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fdb8 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.550086:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959e77 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.550106:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959e77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.550122:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959e77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.550140:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959e7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.550149:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.550157:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.550502:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959e85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.550512:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959e85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.550521:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959e85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788864914.550540:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788864914.550660:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959e77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.550669:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959e77 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.550677:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959e77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.550684:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213ea00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864914.550690:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959e77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.550698:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959e77 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.550745:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:3.0:1788864914.550750:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864914.550756:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959e77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.550764:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959e77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.550779:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.550785:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959e7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.550803:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959e7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.550808:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213f800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864914.550812:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959e7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.550819:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959e7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.550826:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fdc834b8400) 00010000:00010000:3.0:1788864914.550846:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864914.550849:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959e7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.550855:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959e7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.550919:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959e70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdb8 expref: 28 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.550936:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959e85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdb8 expref: 27 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.550945:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc834b8c00) 00010000:00010000:3.0:1788864914.550947:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788864914.550950:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213e600, rc 0) 00000100:00100000:3.0:1788864914.551033:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+27:11551:x1875760528834432:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1106us (1950us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788864914.551052:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 188 00000100:00100000:0.0:1788864914.556939:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864914.556997:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528834560 00000100:00100000:0.0:1788864914.557008:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528834560 00000100:00100000:0.0:1788864914.557070:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 189 00000100:00100000:0.0:1788864914.557082:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+27:11551:x1875760528834560:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:0.0:1788864914.557183:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959e93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.557202:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.557216:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.557249:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.557257:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959e93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.557265:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959e93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.557271:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4b400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864914.557276:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959e93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.557285:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959e93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.557298:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc834b8c00) 00010000:00010000:0.0:1788864914.557302:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788864914.557308:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959e93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.557314:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e959e93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864914.557410:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+27:11551:x1875760528834560:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 330us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864914.557419:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 189 00000100:00100000:3.0:1788864914.566974:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864914.568426:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528834816 00000100:00100000:2.0:1788864914.568448:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528834816 00000100:00100000:2.0:1788864914.570085:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:2.0:1788864914.570108:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+27:11551:x1875760528834816:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788864914.570471:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+28:11551:x1875760528834816:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 371us (3511us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788864914.570480:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:0.0:1788864914.607836:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864914.607919:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528835072 00000100:00100000:3.0:1788864914.607933:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528835072 00000100:00100000:3.0:1788864914.608014:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 190 00000100:00100000:3.0:1788864914.608029:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+28:11085:x1875760528835072:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1788864914.608060:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864914.608091:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959e9a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fdbf expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.608219:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959ea1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.608238:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959e85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdb8 expref: 29 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.608248:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959ea1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.608298:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959e85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdb8 expref: 29 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.608314:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959e85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdb8 expref: 29 pid: 6705 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864914.608330:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0555c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6705:1875760546653696:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788864914.608460:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfdbea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788864914.610013:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0555c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6705:1875760546653696:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788864914.610049:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959ea1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864914.610632:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864914.610741:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528835200 00000100:00100000:2.0:1788864914.610750:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528835200 00010000:00010000:2.0:1788864914.610799:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959e85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdb8 expref: 30 pid: 6705 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864914.610851:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:2.0:1788864914.610871:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+30:2359:x1875760528835200:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788864914.610890:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864914.610897:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959e85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdb8 expref: 30 pid: 6705 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.610912:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959e85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdb8 expref: 30 pid: 6705 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.610957:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959e85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdb8 expref: 30 pid: 6705 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.610977:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc834b8c00) 00010000:00010000:2.0:1788864914.610983:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959ea1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.611003:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959ea1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.611012:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959ea1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.611045:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864914.611101:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+29:2359:x1875760528835200:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 232us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864914.611109:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 73 00010000:00010000:1.0:1788864914.611286:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959ea1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.611301:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959ea1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864914.611346:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788864914.611598:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959e9a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdbf expref: 30 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.611618:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959ea1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdbf expref: 29 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.611627:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc834b8c00) 00010000:00010000:1.0:1788864914.611631:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788864914.611634:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213f800, rc 0) 00000100:00100000:1.0:1788864914.611682:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+29:11085:x1875760528835072:12345-192.168.203.13@tcp:101:bash.0 Request processed in 3658us (3860us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788864914.611691:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 190 00000100:00100000:0.0:1788864914.615188:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864914.621535:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528835456 00000100:00100000:2.0:1788864914.621557:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528835456 00000100:00100000:3.0:1788864914.621935:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 191 00000100:00100000:3.0:1788864914.621949:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+29:11085:x1875760528835456:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:3.0:1788864914.622328:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959eaf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.622349:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959eaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.622364:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959eaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788864914.622427:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1788864914.622453:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d13bdc0e reply state 0000000061eb1a96 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959eaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864914.622464:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788864914.622513:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1788864914.622663:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+33:11085:x1875760528835456:12345-192.168.203.13@tcp:36:bash.0 Request processed in 715us (7488us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1788864914.622671:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 191 00000020:00080000:3.0:1788864914.622678:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788864914.626304:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959eaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.626330:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959eaf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.626340:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959eaf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.626348:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213ea00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864914.626355:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959eaf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.626363:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959eaf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864914.626378:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00010000:00010000:1.0:1788864914.626412:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc834b8c00) 00010000:00010000:1.0:1788864914.626415:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864914.626423:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959eaf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.626430:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959eaf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864914.627344:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528835584 00000100:00100000:3.0:1788864914.627360:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528835584 00000100:00100000:3.0:1788864914.627429:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 192 00000100:00100000:3.0:1788864914.627441:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafcbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+32:11085:x1875760528835584:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1788864914.627479:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864914.627515:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e959eb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fdc6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.627594:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e959eb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdc6 expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.627609:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e959eb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdc6 expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.627631:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc834b8c00) 00010000:00010000:3.0:1788864914.627635:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788864914.627638:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213e400, rc 0) 00000100:00100000:3.0:1788864914.627757:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafcbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+33:11085:x1875760528835584:12345-192.168.203.13@tcp:101:bash.0 Request processed in 317us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864914.627765:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 192 00000100:00100000:1.0:1788864914.634389:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864914.634678:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528835712 00000100:00100000:0.0:1788864914.634693:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528835712 00000100:00100000:0.0:1788864914.634811:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:0.0:1788864914.634824:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:11085:x1875760528835712:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788864914.634851:0:8199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864914.634892:0:8199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e959ebd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fdcd expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788864914.634935:0:8199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9fe990, atime: 0x6a9fe98e, ctime: 0x6a9fe990, blocks: 0xb 00010000:00010000:0.0:1788864914.634962:0:8199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=337s v=(0 0) 00010000:00010000:0.0:1788864914.634968:0:8199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788864914.634977:0:8199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e959ebd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdcd expref: 8 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.634996:0:8199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e959ebd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdcd expref: 8 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.635012:0:8199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4b800, rc 0) 00000100:00100000:0.0:1788864914.635113:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:11085:x1875760528835712:12345-192.168.203.13@tcp:101:bash.0 Request processed in 290us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864914.635121:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:0.0:1788864914.637913:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864914.638062:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528835840 00000100:00100000:1.0:1788864914.638077:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528835840 00002000:00010000:1.0:1788864914.638130:0:6689:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1788864914.638135:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fdcbc86e300 with x1875760528835840 ext(0->18446744073709551615) 00002000:00010000:1.0:1788864914.638149:0:6689:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fdcbc86e300. 00000100:00100000:1.0:1788864914.638188:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:1.0:1788864914.638200:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2357:x1875760528835840:12345-192.168.203.13@tcp:10:bash.0 00002000:00010000:1.0:1788864914.638587:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788864914.638592:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788864912 -> 1788864914 00002000:00010000:1.0:1788864914.638595:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788864910 -> 1788864910 00002000:00010000:1.0:1788864914.638597:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788864912 -> 1788864914 00002000:00010000:1.0:1788864914.638599:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788864914.638678:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:2357:x1875760528835840:12345-192.168.203.13@tcp:10:bash.0 Request processed in 480us (788us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788864914.638686:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00002000:00010000:1.0:1788864914.638691:0:6689:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1788864914.638693:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fdcbc86e300 with x1875760528835840 ext(0->18446744073709551615) 00002000:00010000:1.0:1788864914.638759:0:6689:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fdcbc86e300. 00000100:00100000:1.0:1788864914.731233:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864914.731593:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528835968 00000100:00100000:0.0:1788864914.731606:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528835968 00000100:00100000:0.0:1788864914.731685:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 193 00000100:00100000:0.0:1788864914.731698:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+33:11565:x1875760528835968:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:0.0:1788864914.731849:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959ec4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.731878:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.731893:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.731912:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959ecb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.731920:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.731926:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.732226:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959ed2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.732236:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.732258:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788864914.732310:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.732323:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.732329:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959ec4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.732336:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959ec4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.732342:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4be00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864914.732353:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959ec4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.732776:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959ec4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.732793:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:0.0:1788864914.732797:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864914.732803:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959ec4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.732809:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e959ec4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.732824:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.732889:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959ecb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.732896:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959ecb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.732901:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4b200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864914.732905:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959ecb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.732911:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959ecb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.732921:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fdca4f57a00) 00010000:00010000:0.0:1788864914.732924:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864914.732927:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959ecb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.732934:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959ecb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.732951:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.732959:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959ed2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.732965:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959ed2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.732970:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864914.732981:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959ed2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.732988:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959ed2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.732996:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc834b8c00) 00010000:00010000:0.0:1788864914.732998:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864914.733002:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959ed2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.733008:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959ed2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864914.733220:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+33:11565:x1875760528835968:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 1522us (1999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864914.733231:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 193 00000100:00100000:0.0:1788864914.768649:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864914.768890:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528836224 00000100:00100000:3.0:1788864914.768904:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528836224 00000100:00100000:3.0:1788864914.769011:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 194 00000100:00100000:3.0:1788864914.769024:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+33:11568:x1875760528836224:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788864914.769053:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864914.769083:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959ed9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fdd4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.769183:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959ee0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.769200:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959ee0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.769237:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959ee0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.769256:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959ee7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.769264:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.769271:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.769618:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959eee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.769629:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959eee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.769636:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959eee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788864914.769647:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788864914.770055:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959ee0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.770064:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959ee0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.770071:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959ee0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.770077:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213ec00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864914.770089:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959ee0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.770098:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959ee0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.770113:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:3.0:1788864914.770116:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864914.770122:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959ee0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.770128:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ec00/0xf8c13e2d0e959ee0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.770143:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.770149:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959ee7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.770154:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.770159:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213e600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864914.770162:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.770168:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959ee7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.770175:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fdc834b8a00) 00010000:00010000:3.0:1788864914.770178:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864914.770188:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959ee7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.770194:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e600/0xf8c13e2d0e959ee7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.770247:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e959ed9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdd4 expref: 36 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.770263:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959eee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdd4 expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.770271:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc834b8c00) 00010000:00010000:3.0:1788864914.770273:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788864914.770276:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213f600, rc 0) 00000100:00100000:3.0:1788864914.771640:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+35:11568:x1875760528836224:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1337us (1725us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1788864914.771656:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 194 00000100:00100000:0.0:1788864914.773182:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864914.773258:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528836352 00000100:00100000:3.0:1788864914.773271:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528836352 00000100:00100000:3.0:1788864914.773376:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 195 00000100:00100000:3.0:1788864914.773390:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+35:11568:x1875760528836352:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:3.0:1788864914.773477:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959efc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.773497:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959ea1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdbf expref: 35 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.773507:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959efc lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.773570:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959ea1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdbf expref: 35 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.773585:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959ea1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdbf expref: 35 pid: 6705 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864914.773600:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0555c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875760546653824:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788864914.773746:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfdbe600 going to sleep for 11 seconds 00000100:00100000:0.0:1788864914.777201:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864914.777314:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0555c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875760546653824:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788864914.777349:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959efc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864914.777907:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528836608 00000100:00100000:1.0:1788864914.777917:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528836608 00000100:00100000:1.0:1788864914.777985:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:1.0:1788864914.777996:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+36:5594:x1875760528836608:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788864914.778430:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+37:5594:x1875760528836608:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 433us (1241us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788864914.778438:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:1.0:1788864914.781241:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864914.781943:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528836736 00000100:00100000:3.0:1788864914.781957:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528836736 00010000:00010000:3.0:1788864914.782007:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959ea1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdbf expref: 37 pid: 6705 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864914.782061:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:3.0:1788864914.782073:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81924380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+37:2359:x1875760528836736:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788864914.782093:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864914.782101:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959ea1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdbf expref: 37 pid: 6705 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.782115:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959ea1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdbf expref: 37 pid: 6705 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.782167:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e959ea1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdbf expref: 37 pid: 6705 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.782187:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc834b8c00) 00010000:00010000:3.0:1788864914.782192:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959efc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.782203:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959efc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.782213:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959efc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.782345:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788864914.782435:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81924380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+36:2359:x1875760528836736:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 364us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864914.782444:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 74 00010000:00010000:0.0:1788864914.784126:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959efc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.784145:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959efc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.784192:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959efc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.784201:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959efc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.784208:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959efc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.784215:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc2045800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864914.784239:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959efc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.784248:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959efc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.784266:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc834b8c00) 00010000:00010000:0.0:1788864914.784269:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788864914.784275:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959efc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864914.784282:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959efc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864914.784460:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+35:11568:x1875760528836352:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 11068us (11283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864914.784472:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 195 00000100:00100000:0.0:1788864914.788419:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864914.788571:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528836992 00000100:00100000:1.0:1788864914.788584:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528836992 00000100:00100000:1.0:1788864914.788657:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:1.0:1788864914.788669:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+35:11568:x1875760528836992:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1788864914.789028:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+36:11568:x1875760528836992:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 360us (621us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788864914.789036:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:3.0:1788864914.883402:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864914.883568:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528837248 00000100:00100000:1.0:1788864914.883577:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528837248 00000100:00100000:1.0:1788864914.883629:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 196 00000100:00100000:1.0:1788864914.883637:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+36:11579:x1875760528837248:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:1.0:1788864914.883663:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864914.883682:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959f03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fddb expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.883846:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f0a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.883870:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.883883:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.883898:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959f11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.883905:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959f11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.883912:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959f11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.884126:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959f18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.884135:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.884142:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864914.884151:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788864914.884226:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.884233:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f0a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.884245:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.884250:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864914.884255:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.884262:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f0a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.884273:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:1.0:1788864914.884276:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864914.884281:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.884287:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.884298:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959f11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.884303:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959f11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.884309:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959f11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.884315:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864914.884317:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959f11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.884330:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959f11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.884338:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fdc8328ed00) 00010000:00010000:1.0:1788864914.884340:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864914.884342:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959f11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.884347:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959f11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.884571:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959f03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fddb expref: 39 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.884586:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959f18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fddb expref: 38 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.884591:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc834b8c00) 00010000:00010000:1.0:1788864914.884593:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788864914.884596:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc75400, rc 0) 00000100:00100000:1.0:1788864914.884696:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+38:11579:x1875760528837248:12345-192.168.203.13@tcp:101:cat.0 Request processed in 1059us (1303us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788864914.884745:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 196 00000100:00100000:2.0:1788864914.894381:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864914.895717:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528837504 00000100:00100000:1.0:1788864914.895729:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528837504 00000100:00100000:0.0:1788864914.896051:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:0.0:1788864914.896062:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+38:11579:x1875760528837504:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:0.0:1788864914.896487:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+39:11579:x1875760528837504:12345-192.168.203.13@tcp:35:cat.0 Request processed in 425us (2113us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788864914.896496:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:0.0:1788864914.927214:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864914.927313:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528837760 00000100:00100000:1.0:1788864914.927325:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528837760 00000100:00100000:1.0:1788864914.927400:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 197 00000100:00100000:1.0:1788864914.927412:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+39:11580:x1875760528837760:12345-192.168.203.13@tcp:36:rm.0 00010000:00010000:1.0:1788864914.927498:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788864914.927527:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959f18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fddb expref: 39 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.927550:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e959eee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdd4 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.927563:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e959eb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdc6 expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.927572:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc834b8c00) 00010000:00010000:1.0:1788864914.927583:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788864914.927604:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959f26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.927617:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959f26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.927626:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959f26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.927639:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959f2d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.927645:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959f2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.927652:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959f2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.927966:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f34 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.927974:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.927980:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788864914.928469:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1788864914.928478:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 338059774105ns, next at 339059771815ns, rc = 0 00010000:00010000:1.0:1788864914.928534:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e959f3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.928543:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e959f3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.928552:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e959f3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.928559:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e959f3b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.928565:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e959f3b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.928570:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e959f3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.928602:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788864914.928622:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.928635:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f34 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.928641:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f34 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.928647:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864914.928652:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f34 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.928659:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f34 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.928669:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc8328e100) 00010000:00010000:1.0:1788864914.928672:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788864914.928676:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f34 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.928682:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f34 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.928697:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959f26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.928730:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959f26 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.928737:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959f26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.928742:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864914.928751:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959f26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.928757:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959f26 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.928765:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:1.0:1788864914.928767:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864914.928771:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959f26 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.928777:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959f26 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788864914.928787:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0a98776 reply state 00000000a7722383 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959f2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864914.928795:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788864914.928889:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+38:11580:x1875760528837760:12345-192.168.203.13@tcp:36:rm.0 Request processed in 1477us (1682us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1788864914.928898:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 197 00010000:00010000:3.0:1788864914.930142:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788864914.930154:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e959f3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.930163:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75800 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:3.0:1788864914.930168:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e959f3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.930177:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e959f3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.930208:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fdc8328e100) 00010000:00010000:3.0:1788864914.930211:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788864914.930215:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e959f3b lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.930222:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e959f3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.930246:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864914.930249:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864914.930250:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864914.933561:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959f2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.933581:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959f2d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.933588:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959f2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.933594:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864914.933599:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959f2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.933620:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959f2d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.933636:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fdc8328ed00) 00010000:00010000:1.0:1788864914.933639:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864914.933644:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959f2d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.933651:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e959f2d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864914.985224:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864914.985320:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528838016 00000100:00100000:3.0:1788864914.985330:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528838016 00000100:00100000:3.0:1788864914.985395:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 198 00000100:00100000:3.0:1788864914.985405:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+37:11586:x1875760528838016:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1788864914.985428:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864914.985447:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045e00/0xf8c13e2d0e959f42 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fde2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.985570:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045600/0xf8c13e2d0e959f49 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.985586:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045600/0xf8c13e2d0e959f49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.985598:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045600/0xf8c13e2d0e959f49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.985613:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044e00/0xf8c13e2d0e959f50 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.985634:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044e00/0xf8c13e2d0e959f50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.985641:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044e00/0xf8c13e2d0e959f50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788864914.986443:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788864914.986883:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959f57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.986896:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.986906:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.986942:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045600/0xf8c13e2d0e959f49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.986949:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045600/0xf8c13e2d0e959f49 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.986956:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045600/0xf8c13e2d0e959f49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.986962:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc2045600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864914.986967:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045600/0xf8c13e2d0e959f49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.986974:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045600/0xf8c13e2d0e959f49 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.986999:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:3.0:1788864914.987002:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864914.987008:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045600/0xf8c13e2d0e959f49 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.987013:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045600/0xf8c13e2d0e959f49 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788864914.987027:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057354a94 reply state 00000000e6227f5d transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044e00/0xf8c13e2d0e959f50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864914.987036:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788864914.987069:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045e00/0xf8c13e2d0e959f42 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fde2 expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.987083:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959f57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fde2 expref: 39 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864914.987091:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc834b8400) 00010000:00010000:3.0:1788864914.987093:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788864914.987095:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcc2045800, rc 0) 00000100:00100000:3.0:1788864914.987394:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+40:11586:x1875760528838016:12345-192.168.203.13@tcp:101:bash.0 Request processed in 1947us (2136us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788864914.987402:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 198 00010000:00010000:2.0:1788864914.990172:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044e00/0xf8c13e2d0e959f50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.990190:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044e00/0xf8c13e2d0e959f50 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.990197:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044e00/0xf8c13e2d0e959f50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.990203:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc2044e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864914.990220:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044e00/0xf8c13e2d0e959f50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.990228:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044e00/0xf8c13e2d0e959f50 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.990242:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fdc834b8a00) 00010000:00010000:2.0:1788864914.990245:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864914.990250:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044e00/0xf8c13e2d0e959f50 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864914.990257:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044e00/0xf8c13e2d0e959f50 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864914.994519:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864914.994664:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528838144 00000100:00100000:1.0:1788864914.994674:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528838144 00000100:00100000:1.0:1788864914.994793:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:1.0:1788864914.994803:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2356:x1875760528838144:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788864914.994821:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864914.994852:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c89bc6b/0xf8c13e2d0e959f65 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fde9 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788864914.994888:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788864914.994908:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=338s v=(0 0) 00010000:00010000:1.0:1788864914.994912:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864914.994921:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c89bc6b/0xf8c13e2d0e959f65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fde9 expref: 6 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.994941:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c89bc6b/0xf8c13e2d0e959f65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fde9 expref: 6 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864914.994974:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc74c00, rc 0) 00000100:00100000:1.0:1788864914.995038:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2356:x1875760528838144:12345-192.168.203.13@tcp:101:bash.0 Request processed in 237us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864914.995045:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00080000:0.0:1788864914.995642:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788864915.000589:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864915.002068:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528838272 00000100:00100000:0.0:1788864915.002083:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528838272 00000100:00100000:0.0:1788864915.002226:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:0.0:1788864915.002238:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0557480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:11586:x1875760528838272:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788864915.002258:0:8199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864915.002276:0:8199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007c1543c/0xf8c13e2d0e959f6c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fdf0 expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.002306:0:8199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c89bc6b/0xf8c13e2d0e959f65 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fde9 expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.002315:0:8199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788864915.002319:0:8199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788864915.002325:0:8199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007c1543c/0xf8c13e2d0e959f6c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdf0 expref: 7 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.002369:0:8199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c89bc6b/0xf8c13e2d0e959f65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fde9 expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.002383:0:8199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c89bc6b/0xf8c13e2d0e959f65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fde9 expref: 7 pid: 6684 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864915.002396:0:8199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc86c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8199:1875760546653952:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788864915.002618:0:8199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598480 going to sleep for 11 seconds 00000100:00100000:3.0:1788864915.005677:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864915.005980:0:8199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc86c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8199:1875760546653952:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788864915.006016:0:8199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000007c1543c/0xf8c13e2d0e959f6c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdf0 expref: 7 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.006058:0:8199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4a400, rc 0) 00000100:00100000:0.0:1788864915.006122:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0557480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:11586:x1875760528838272:12345-192.168.203.13@tcp:101:bash.0 Request processed in 3886us (5541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864915.006130:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:2.0:1788864915.009123:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528838400 00000100:00100000:2.0:1788864915.009139:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528838400 00010000:00010000:2.0:1788864915.009193:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c89bc6b/0xf8c13e2d0e959f65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fde9 expref: 7 pid: 6684 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864915.009230:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:2.0:1788864915.009240:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0554a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2359:x1875760528838400:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788864915.009255:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864915.009276:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c89bc6b/0xf8c13e2d0e959f65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fde9 expref: 7 pid: 6684 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.009290:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c89bc6b/0xf8c13e2d0e959f65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fde9 expref: 7 pid: 6684 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.009312:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c89bc6b/0xf8c13e2d0e959f65 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fde9 expref: 7 pid: 6684 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.009342:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864915.009347:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864915.009604:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000007c1543c/0xf8c13e2d0e959f6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdf0 expref: 6 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.009616:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007c1543c/0xf8c13e2d0e959f6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdf0 expref: 6 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.009658:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000007c1543c/0xf8c13e2d0e959f6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdf0 expref: 6 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864915.009672:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc859500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5820:1875760546654080:192.168.203.13@tcp:105: 00000100:00100000:2.0:1788864915.010115:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1505cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1788864915.013535:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864915.013663:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc859500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5820:1875760546654080:192.168.203.13@tcp:105: 00010000:00010000:1.0:1788864915.013686:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864915.014176:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0554a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2359:x1875760528838400:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 4935us (8506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864915.014187:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:3.0:1788864915.015976:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864915.016213:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528838656 00000100:00100000:2.0:1788864915.016223:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528838656 00000100:00100000:2.0:1788864915.016278:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:2.0:1788864915.016289:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+39:11586:x1875760528838656:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:2.0:1788864915.017172:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+40:11586:x1875760528838656:12345-192.168.203.13@tcp:35:bash.0 Request processed in 882us (1199us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788864915.017182:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:2.0:1788864915.200145:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864915.201231:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528838784 00000100:00100000:1.0:1788864915.201243:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528838784 00000100:00100000:1.0:1788864915.201307:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 199 00000100:00100000:1.0:1788864915.201318:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+40:11602:x1875760528838784:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788864915.201341:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864915.201372:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959f73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fdf7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.201477:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.201492:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.201504:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864915.201558:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788864915.201562:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788864915.201580:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.201603:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75a00/0xf8c13e2d0e959f73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdf7 expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.201622:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdf7 expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.201630:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:1.0:1788864915.201633:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788864915.201637:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc74000, rc 0) 00000100:00100000:1.0:1788864915.201697:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+41:11602:x1875760528838784:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 382us (1562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864915.201763:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 199 00000100:00100000:1.0:1788864915.205219:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864915.205304:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528839040 00000100:00100000:3.0:1788864915.205325:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528839040 00000100:00100000:3.0:1788864915.205386:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 200 00000100:00100000:3.0:1788864915.205396:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+41:11602:x1875760528839040:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788864915.205414:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864915.205433:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044600/0xf8c13e2d0e959f81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fdfe expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.205884:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044000/0xf8c13e2d0e959f88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.205898:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044000/0xf8c13e2d0e959f88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.205910:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044000/0xf8c13e2d0e959f88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788864915.205920:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788864915.206033:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044600/0xf8c13e2d0e959f81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdfe expref: 44 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.206053:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044000/0xf8c13e2d0e959f88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdfe expref: 43 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.206061:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc834b8400) 00010000:00010000:3.0:1788864915.206064:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788864915.206068:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcc2044000, rc 0) 00000100:00100000:3.0:1788864915.206292:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+43:11602:x1875760528839040:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 897us (1080us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788864915.206301:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 200 00000100:00100000:3.0:1788864915.211151:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864915.211207:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864915.212768:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528839168 00000100:00100000:1.0:1788864915.212781:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528839168 00000100:00100000:1.0:1788864915.212874:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:1.0:1788864915.212885:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1e53850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+43:2358:x1875760528839168:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864915.212902:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864915.212928:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044000/0xf8c13e2d0e959f88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdfe expref: 43 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.212948:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc834b8400) 00010000:00010000:1.0:1788864915.212967:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864915.213032:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1e53850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+42:2358:x1875760528839168:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 149us (1889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864915.213040:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:2.0:1788864915.213739:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528839424 00000100:00100000:2.0:1788864915.213747:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528839424 00000100:00100000:2.0:1788864915.213799:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 201 00000100:00100000:2.0:1788864915.213808:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+42:11602:x1875760528839424:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788864915.213838:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864915.213863:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959f96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fe05 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.213951:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959f9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.213964:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.213974:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864915.213986:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788864915.214103:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385a00/0xf8c13e2d0e959f96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe05 expref: 45 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.214761:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959f9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe05 expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.214772:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc834b8400) 00010000:00010000:2.0:1788864915.214776:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788864915.214780:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384600, rc 0) 00000100:00100000:2.0:1788864915.214865:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+44:11602:x1875760528839424:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1058us (3656us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788864915.214875:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 201 00000100:00100000:3.0:1788864915.228902:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864915.228991:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528839552 00000100:00100000:1.0:1788864915.229002:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528839552 00000100:00100000:1.0:1788864915.229066:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:1.0:1788864915.229076:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+6:2359:x1875760528839552:12345-192.168.203.13@tcp:1:lfs.0 00010000:00010000:1.0:1788864915.229118:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000382be09e/0xf8c13e2d0e959fab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.229138:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000007c1543c/0xf8c13e2d0e959f6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdf0 expref: 6 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.229147:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864915.229151:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788864915.229156:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000382be09e/0xf8c13e2d0e959fab lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.229191:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000007c1543c/0xf8c13e2d0e959f6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdf0 expref: 6 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.229205:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000007c1543c/0xf8c13e2d0e959f6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdf0 expref: 6 pid: 8199 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864915.229219:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81924380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6684:1875760546654208:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788864915.229308:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc90902600 going to sleep for 11 seconds 00000100:00100000:0.0:1788864915.233473:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864915.233513:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81924380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6684:1875760546654208:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788864915.233541:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000382be09e/0xf8c13e2d0e959fab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864915.235136:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528839680 00000100:00100000:2.0:1788864915.235162:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528839680 00002000:00100000:3.0:1788864915.238505:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9fdcbc86c000 x1875760528839680/t0(0) o4->1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp:391/0 lens 504/0 e 0 to 0 dl 1788864926 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788864915.238520:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fdcbc86c000 with x1875760528839680 ext(0->8) 00010000:00010000:3.0:1788864915.238531:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000007c1543c/0xf8c13e2d0e959f6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdf0 expref: 7 pid: 8199 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.238550:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000007c1543c/0xf8c13e2d0e959f6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdf0 expref: 7 pid: 8199 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788864915.238558:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fdcbc86c000 00000100:00100000:3.0:1788864915.238597:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:3.0:1788864915.238609:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2359:x1875760528839680:12345-192.168.203.13@tcp:4:lfs.0 00000100:00100000:3.0:1788864915.240077:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:2359:x1875760528839680:12345-192.168.203.13@tcp:4:lfs.0 Request processed in 1464us (6608us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788864915.240088:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00002000:00100000:3.0:1788864915.240098:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9fdcbc86c000 x1875760528839680/t4294967308(0) o4->1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp:391/0 lens 504/448 e 0 to 0 dl 1788864926 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788864915.240108:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fdcbc86c000 with x1875760528839680 ext(0->8) 00010000:00010000:3.0:1788864915.240117:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000007c1543c/0xf8c13e2d0e959f6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdf0 expref: 9 pid: 8199 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.240134:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000007c1543c/0xf8c13e2d0e959f6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdf0 expref: 9 pid: 8199 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788864915.240150:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fdcbc86c000 00000100:00100000:3.0:1788864915.244150:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864915.244252:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528839808 00000100:00100000:1.0:1788864915.244262:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528839808 00010000:00010000:1.0:1788864915.244301:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000007c1543c/0xf8c13e2d0e959f6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdf0 expref: 9 pid: 8199 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864915.244384:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:1.0:1788864915.244395:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbff03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:2356:x1875760528839808:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864915.244410:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788864915.244429:0:5820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788864915.244432:0:5820:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788864914 00002000:00010000:1.0:1788864915.244434:0:5820:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788864914 00002000:00010000:1.0:1788864915.244437:0:5820:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788864914 00010000:00010000:1.0:1788864915.244443:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000007c1543c/0xf8c13e2d0e959f6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdf0 expref: 9 pid: 8199 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.244457:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000007c1543c/0xf8c13e2d0e959f6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdf0 expref: 9 pid: 8199 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.244555:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007c1543c/0xf8c13e2d0e959f6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdf0 expref: 9 pid: 8199 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.244572:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788864915.244588:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788864915.244594:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000382be09e/0xf8c13e2d0e959fab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.244604:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000382be09e/0xf8c13e2d0e959fab lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.244643:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788864915.244817:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000382be09e/0xf8c13e2d0e959fab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864915.244951:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2356:x1875760528839808:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 557us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864915.244961:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 76 00010000:00010000:3.0:1788864915.245110:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000382be09e/0xf8c13e2d0e959fab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.245141:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000382be09e/0xf8c13e2d0e959fab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.245149:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000382be09e/0xf8c13e2d0e959fab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.245157:0:6684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000382be09e/0xf8c13e2d0e959fab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.245163:0:6684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75a00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:3.0:1788864915.245167:0:6684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000382be09e/0xf8c13e2d0e959fab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.245175:0:6684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000382be09e/0xf8c13e2d0e959fab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.245186:0:6684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000382be09e/0xf8c13e2d0e959fab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.245203:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000382be09e/0xf8c13e2d0e959fab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864915.245250:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbff01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2359:x1875760528839552:12345-192.168.203.13@tcp:1:lfs.0 Request processed in 16175us (16359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864915.245258:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:1.0:1788864915.249799:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864915.250016:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528840064 00000100:00100000:0.0:1788864915.250035:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528840064 00000100:00100000:0.0:1788864915.250090:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:0.0:1788864915.250100:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca21f7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+44:11602:x1875760528840064:12345-192.168.203.13@tcp:35:lfs.0 00000004:00010000:0.0:1788864915.250160:0:5839:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959f9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe05 expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788864915.250421:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1788864915.250649:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1788864915.251415:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1788864915.251614:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959fb2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.251632:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959f57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fde2 expref: 48 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.251640:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959fb2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.251675:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959f57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fde2 expref: 48 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.252533:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959f57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fde2 expref: 48 pid: 5837 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864915.252551:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc86d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5839:1875760546654336:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788864915.252646:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598480 going to sleep for 11 seconds 00000100:00100000:0.0:1788864915.256040:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864915.256203:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc86d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5839:1875760546654336:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788864915.256229:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959fb2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864915.256299:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528840192 00000100:00100000:2.0:1788864915.256306:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528840192 00010000:00010000:2.0:1788864915.256340:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959f57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fde2 expref: 49 pid: 5837 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864915.256383:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:2.0:1788864915.256392:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+49:2358:x1875760528840192:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788864915.256407:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864915.256414:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959f57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fde2 expref: 49 pid: 5837 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.256425:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959f57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fde2 expref: 49 pid: 5837 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.256445:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e959f57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fde2 expref: 49 pid: 5837 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.256462:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc834b8400) 00010000:00010000:2.0:1788864915.256477:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959fb2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.256486:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959fb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.256494:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959fb2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.256520:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864915.256571:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+48:2358:x1875760528840192:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 179us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864915.256590:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 77 00010000:00010000:0.0:1788864915.257300:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959fb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.257310:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959fb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788864915.257437:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788864915.257802:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1788864915.258182:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc86c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1875760546654464:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788864915.258235:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864915.258266:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598480 going to sleep for 11 seconds 00000100:00100000:2.0:1788864915.258451:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546654464 00000100:00100000:2.0:1788864915.258457:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546654464 00000100:00100000:2.0:1788864915.258520:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788864915.258528:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5839:x1875760546654464:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788864915.258599:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5839:x1875760546654464:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 72us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864915.258606:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788864915.258682:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc86c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1875760546654464:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788864915.259161:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1788864915.259217:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdca003c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1875760546654592:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788864915.259251:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864915.259271:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfdbee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788864915.259588:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546654592 00000100:00100000:1.0:1788864915.259594:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546654592 00000100:00100000:1.0:1788864915.259622:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788864915.259628:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1875760546654592:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788864915.259807:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5839:x1875760546654592:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 178us (555us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788864915.259815:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788864915.260512:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788864915.260670:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdca003c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1875760546654592:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788864915.260765:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1788864915.260809:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959fb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.260819:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959fb2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.260828:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959fb2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.260848:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864915.260938:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959fb2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.260947:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959fb2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.260962:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc834b8400) 00010000:00010000:3.0:1788864915.260965:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788864915.260970:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959fb2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.260976:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a600/0xf8c13e2d0e959fb2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788864915.261170:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788864915.261265:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1788864915.261276:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 338392571236ns, next at 339392568966ns, rc = 0 00000001:00080000:3.0:1788864915.261282:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1788864915.261316:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc834b8400) 00010000:00010000:3.0:1788864915.261319:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788864915.261325:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959f9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe05 expref: 52 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864915.261447:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca21f7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+51:11602:x1875760528840064:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 11347us (11656us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1788864915.261456:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00000020:00080000:3.0:1788864915.261461:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788864915.269118:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864915.269247:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528840320 00000100:00100000:1.0:1788864915.269257:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528840320 00000100:00100000:1.0:1788864915.269311:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 202 00000100:00100000:1.0:1788864915.269322:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+51:11602:x1875760528840320:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788864915.269343:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864915.269376:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959fb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fe0c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.269453:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959fb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe0c expref: 52 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.269476:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959fb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe0c expref: 52 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.269494:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:1.0:1788864915.269497:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788864915.269501:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc75600, rc 0) 00000100:00100000:1.0:1788864915.269563:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+52:11602:x1875760528840320:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 243us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864915.269570:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 202 00000100:00100000:1.0:1788864915.274055:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864915.274153:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528840576 00000100:00100000:2.0:1788864915.274163:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528840576 00000100:00100000:2.0:1788864915.274217:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:2.0:1788864915.274228:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+52:11602:x1875760528840576:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788864915.274476:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+53:11602:x1875760528840576:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 250us (430us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1788864915.274484:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:2.0:1788864915.346970:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864915.347020:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864915.347462:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528840704 00000100:00100000:3.0:1788864915.347483:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528840704 00000100:00100000:3.0:1788864915.347539:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 292 00000100:00100000:3.0:1788864915.347550:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:2357:x1875760528840704:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864915.347627:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+13:2357:x1875760528840704:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 78us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864915.347636:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 292 00000100:00100000:0.0:1788864915.351582:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528840832 00000100:00100000:0.0:1788864915.351597:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528840832 00000100:00100000:0.0:1788864915.351755:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 146 00000100:00100000:0.0:1788864915.351766:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2357:x1875760528840832:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788864915.351849:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2357:x1875760528840832:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 86us (4828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864915.351866:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 146 00000100:00080000:1.0:1788864915.358291:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788864915.383782:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864915.383859:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528840960 00000100:00100000:1.0:1788864915.383869:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528840960 00000100:00100000:1.0:1788864915.383929:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 203 00000100:00100000:1.0:1788864915.383940:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc85a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+53:11612:x1875760528840960:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:1.0:1788864915.384012:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959fc0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384038:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959fc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384057:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959fc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384091:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959fc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384099:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384106:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384196:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959fce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384205:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959fce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384212:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959fce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788864915.384250:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959fce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384262:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959fc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384268:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959fc0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384275:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959fc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384282:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864915.384285:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959fc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384299:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959fc0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384311:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:1.0:1788864915.384314:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864915.384320:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959fc0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384326:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e959fc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384338:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384343:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959fc7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384348:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959fc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384354:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864915.384808:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959fc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384816:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959fc7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384823:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fdc8328ef00) 00010000:00010000:1.0:1788864915.384824:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864915.384827:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959fc7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384840:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e959fc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384861:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959fce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384868:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959fce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384874:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959fce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384882:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864915.384886:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959fce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384891:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959fce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384899:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:1.0:1788864915.384901:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864915.384905:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959fce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.384910:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959fce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864915.384998:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc85a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+53:11612:x1875760528840960:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 1054us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864915.385008:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 203 00000100:00100000:3.0:1788864915.440349:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864915.444340:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528841216 00000100:00100000:0.0:1788864915.444357:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528841216 00000100:00100000:0.0:1788864915.444434:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 204 00000100:00100000:0.0:1788864915.444444:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+53:11615:x1875760528841216:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788864915.444474:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864915.444494:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959fd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fe13 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.444576:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959fdc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.444591:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959fdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.444603:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959fdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.444618:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959fe3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.444625:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.444631:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.444787:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959fea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.444797:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.444824:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864915.444834:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788864915.444942:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959fdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.444951:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959fdc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.444959:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959fdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.444965:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864915.444970:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959fdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.444978:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959fdc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.444990:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:0.0:1788864915.444993:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864915.444998:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959fdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.445004:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e959fdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.445018:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.445026:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959fe3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.445039:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959fe3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.445044:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4ae00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864915.445047:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959fe3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.445053:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959fe3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.445061:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fdca4f57a00) 00010000:00010000:0.0:1788864915.445063:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864915.445066:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959fe3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.445071:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e959fe3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.445111:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b200/0xf8c13e2d0e959fd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe13 expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.445128:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959fea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe13 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.445135:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:0.0:1788864915.445136:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788864915.445139:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4b000, rc 0) 00000100:00100000:0.0:1788864915.445205:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+55:11615:x1875760528841216:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 762us (4864us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788864915.445222:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 204 00000100:00100000:3.0:1788864915.456956:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864915.457177:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528841344 00000100:00100000:1.0:1788864915.457187:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528841344 00000100:00100000:1.0:1788864915.457248:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 205 00000100:00100000:1.0:1788864915.457258:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfe08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+55:11615:x1875760528841344:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:1.0:1788864915.457321:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959ff8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.457339:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.457350:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.457387:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.457394:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959ff8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.457400:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959ff8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.457406:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864915.457410:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959ff8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.457417:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959ff8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.457428:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:1.0:1788864915.457431:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788864915.457436:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959ff8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.457455:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e959ff8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864915.457686:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfe08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+55:11615:x1875760528841344:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 429us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864915.457694:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 205 00000100:00100000:2.0:1788864915.464542:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864915.468207:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528841600 00000100:00100000:3.0:1788864915.468220:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528841600 00000100:00100000:3.0:1788864915.468279:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:3.0:1788864915.468291:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+55:11615:x1875760528841600:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1788864915.468655:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+56:11615:x1875760528841600:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 365us (4120us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788864915.468663:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:0.0:1788864915.566452:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864915.568959:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528841856 00000100:00100000:2.0:1788864915.568973:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528841856 00000100:00100000:2.0:1788864915.569105:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 206 00000100:00100000:2.0:1788864915.569116:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+56:11625:x1875760528841856:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1788864915.569141:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864915.569144:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788864915.569183:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e959f7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdf7 expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.569203:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:2.0:1788864915.569209:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788864915.569223:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959fff lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fe1a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.569314:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a006 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.569327:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.569337:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864915.569357:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788864915.569474:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e959fff lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe1a expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.569489:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a006 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe1a expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.569497:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:2.0:1788864915.569500:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788864915.569502:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385000, rc 0) 00000100:00100000:2.0:1788864915.569568:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+57:11625:x1875760528841856:12345-192.168.203.13@tcp:101:bash.0 Request processed in 453us (3124us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788864915.569576:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 206 00000100:00100000:1.0:1788864915.573969:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864915.574933:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528842112 00000100:00100000:3.0:1788864915.574945:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528842112 00000100:00100000:3.0:1788864915.575009:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 207 00000100:00100000:3.0:1788864915.575020:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+57:11625:x1875760528842112:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:3.0:1788864915.575089:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788864915.575114:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a006 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe1a expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.575139:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b000/0xf8c13e2d0e959fea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe13 expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.575167:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:3.0:1788864915.575173:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788864915.575381:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e95a014 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.575395:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e95a014 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.575405:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e95a014 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788864915.575454:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1788864915.575478:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000485794f0 reply state 000000005aff02c5 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e95a014 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864915.575487:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788864915.575590:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+58:11625:x1875760528842112:12345-192.168.203.13@tcp:36:bash.0 Request processed in 571us (1629us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788864915.575598:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 207 00000020:00080000:3.0:1788864915.575602:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788864915.585107:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e95a014 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.585123:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e95a014 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.585131:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e95a014 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.585136:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc2045800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864915.585141:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e95a014 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.585149:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e95a014 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.585164:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:2.0:1788864915.585166:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864915.585171:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e95a014 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.585178:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e95a014 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864915.588109:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864915.588258:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528842240 00000100:00100000:0.0:1788864915.588268:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528842240 00000100:00100000:0.0:1788864915.588325:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 208 00000100:00100000:0.0:1788864915.588335:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+57:11625:x1875760528842240:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788864915.588365:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864915.588388:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e95a01b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fe21 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.588469:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e95a022 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.588484:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e95a022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.588495:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e95a022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864915.588534:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788864915.588539:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788864915.588556:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e95a022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.588580:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e95a01b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe21 expref: 59 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.588597:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e95a022 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe21 expref: 58 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.588623:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:0.0:1788864915.588626:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788864915.588630:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4aa00, rc 0) 00000100:00100000:0.0:1788864915.588695:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+58:11625:x1875760528842240:12345-192.168.203.13@tcp:101:bash.0 Request processed in 361us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864915.588746:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 208 00000100:00100000:1.0:1788864915.595783:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864915.595927:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528842496 00000100:00100000:0.0:1788864915.595937:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528842496 00000100:00100000:0.0:1788864915.596001:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:0.0:1788864915.596014:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+58:11625:x1875760528842496:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:0.0:1788864915.596272:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+59:11625:x1875760528842496:12345-192.168.203.13@tcp:35:bash.0 Request processed in 259us (498us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788864915.596280:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:3.0:1788864915.709733:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864915.709903:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528842624 00000100:00100000:1.0:1788864915.709912:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528842624 00000100:00100000:1.0:1788864915.709971:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:1.0:1788864915.709981:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+59:11631:x1875760528842624:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788864915.710004:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864915.710024:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e95a029 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fe28 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.710087:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95a030 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.710102:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95a030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.710114:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95a030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864915.710148:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788864915.710152:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788864915.710184:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95a030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.710211:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e95a029 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe28 expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.710229:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95a030 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe28 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.710237:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:1.0:1788864915.710240:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788864915.710243:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc75200, rc 0) 00000100:00100000:1.0:1788864915.710317:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+60:11631:x1875760528842624:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 337us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864915.710325:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:3.0:1788864915.715144:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864915.715231:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528842752 00000100:00100000:0.0:1788864915.715241:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528842752 00000100:00100000:0.0:1788864915.715306:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00100000:0.0:1788864915.715317:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+60:11631:x1875760528842752:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788864915.715335:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864915.715353:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e95a037 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fe2f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.715616:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a03e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.715629:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a03e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.715655:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a03e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.715671:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a045 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.715745:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.715752:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.715834:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a04c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.715842:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a04c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.715861:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a04c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864915.715894:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788864915.715898:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788864915.715914:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a04c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.715924:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a04c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.715932:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a03e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.715950:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a03e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.715957:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a03e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.715963:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4ba00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864915.715967:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a03e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.715975:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a03e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.715985:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:0.0:1788864915.715988:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864915.715993:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a03e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.715999:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a03e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.716011:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.716017:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a045 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.716023:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a045 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.716028:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864915.716036:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a045 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.716043:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a045 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.716050:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fdca4f57a00) 00010000:00010000:0.0:1788864915.716053:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864915.716056:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a045 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.716062:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a045 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.716091:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a800/0xf8c13e2d0e95a037 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe2f expref: 62 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.716104:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a04c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe2f expref: 61 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.716111:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:0.0:1788864915.716113:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788864915.716116:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4b400, rc 0) 00000100:00100000:0.0:1788864915.716181:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+61:11631:x1875760528842752:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 865us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864915.716188:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00100000:3.0:1788864915.720907:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864915.720975:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864915.721047:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528843008 00000100:00100000:1.0:1788864915.721056:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528843008 00000100:00100000:1.0:1788864915.721109:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:1.0:1788864915.721119:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafc99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+61:2358:x1875760528843008:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864915.721134:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864915.721159:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a04c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe2f expref: 61 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.721176:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:1.0:1788864915.721181:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864915.721231:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafc99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+60:2358:x1875760528843008:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 113us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864915.721238:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:0.0:1788864915.722287:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528843136 00000100:00100000:0.0:1788864915.722294:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528843136 00000100:00100000:0.0:1788864915.722385:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 211 00000100:00100000:0.0:1788864915.722395:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+60:11631:x1875760528843136:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788864915.722421:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864915.722439:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e95a053 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fe36 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.722534:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e95a05a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.722548:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e95a022 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe21 expref: 61 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.722557:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e95a05a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.722589:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e95a022 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe21 expref: 61 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.722602:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e95a022 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe21 expref: 61 pid: 5836 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864915.722614:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc86c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875760546654720:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788864915.722693:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598000 going to sleep for 11 seconds 00000100:00100000:0.0:1788864915.725604:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc86c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875760546654720:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788864915.725632:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e95a05a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864915.726394:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864915.726454:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528843264 00000100:00100000:1.0:1788864915.726462:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528843264 00010000:00010000:1.0:1788864915.726497:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e95a022 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe21 expref: 62 pid: 5836 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864915.726534:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:1.0:1788864915.726542:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafc99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+62:2359:x1875760528843264:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864915.726556:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864915.726562:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e95a022 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe21 expref: 62 pid: 5836 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.726574:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e95a022 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe21 expref: 62 pid: 5836 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.726595:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4aa00/0xf8c13e2d0e95a022 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe21 expref: 62 pid: 5836 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.726608:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:1.0:1788864915.726613:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e95a05a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.726621:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e95a05a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.726629:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e95a05a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.726661:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864915.726733:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafc99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+61:2359:x1875760528843264:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 162us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864915.726753:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 78 00010000:00010000:0.0:1788864915.726816:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e95a05a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.726824:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e95a05a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864915.726864:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788864915.726996:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e95a053 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe36 expref: 62 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.727012:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e95a05a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe36 expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.727019:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:0.0:1788864915.727021:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788864915.727023:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4a200, rc 0) 00000100:00100000:0.0:1788864915.727046:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+61:11631:x1875760528843136:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 4654us (6071us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788864915.727053:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 211 00000100:00100000:3.0:1788864915.730329:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864915.730470:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528843520 00000100:00100000:1.0:1788864915.730480:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528843520 00000100:00100000:1.0:1788864915.730542:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:1.0:1788864915.730554:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafc98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+61:11631:x1875760528843520:12345-192.168.203.13@tcp:103:lfs.0 00010000:00010000:1.0:1788864915.730570:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864915.730593:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e959fb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe0c expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.730611:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:1.0:1788864915.730615:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864915.730660:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafc98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+60:11631:x1875760528843520:12345-192.168.203.13@tcp:103:lfs.0 Request processed in 109us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864915.730667:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:3.0:1788864915.733104:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864915.733186:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528843648 00000100:00100000:1.0:1788864915.733196:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528843648 00000100:00100000:1.0:1788864915.733257:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 212 00000100:00100000:1.0:1788864915.733268:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafc99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+60:11631:x1875760528843648:12345-192.168.203.13@tcp:58:lfs.0 00010000:00010000:1.0:1788864915.733374:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e95a068 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.733391:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e95a068 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.733403:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e95a068 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788864915.733607:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788864915.733696:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafc99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+60:11631:x1875760528843648:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 430us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864915.734798:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 212 00000100:00100000:3.0:1788864915.736754:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864915.736869:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528843776 00000100:00100000:2.0:1788864915.736879:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528843776 00000100:00100000:2.0:1788864915.736934:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 213 00000100:00100000:2.0:1788864915.736944:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+60:11631:x1875760528843776:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788864915.736964:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864915.736983:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e95a06f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fe3d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.737049:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e95a068 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.737061:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e95a06f lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe3d expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.737079:0:5835:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e95a068 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.737092:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e95a06f lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe3d expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.737107:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:2.0:1788864915.737111:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788864915.737115:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e95a06f lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe3d expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.737123:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385800, rc 0) 00000100:00100000:2.0:1788864915.737180:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+61:11631:x1875760528843776:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 237us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864915.737187:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 213 00000040:00080000:0.0:1788864915.780960:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788864915.780969:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788864915.781198:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788864915.781206:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788864915.781390:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc86c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1875760546654848:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788864915.781496:0:11671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788864915.785622:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864915.785796:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc86c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1875760546654848:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788864915.786076:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528843904 00000100:00100000:1.0:1788864915.786084:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528843904 00000100:00100000:1.0:1788864915.786139:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 214 00000100:00100000:1.0:1788864915.786149:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+61:11632:x1875760528843904:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788864915.786175:0:6705:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788864915.786268:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+61:11632:x1875760528843904:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 119us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864915.786275:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 214 00000100:00100000:2.0:1788864915.791811:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864915.791970:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528844032 00000100:00100000:1.0:1788864915.791980:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528844032 00000100:00100000:1.0:1788864915.792042:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 215 00000100:00100000:1.0:1788864915.792053:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+61:11632:x1875760528844032:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788864915.792123:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95a076 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792140:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95a076 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792152:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95a076 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792167:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e95a07d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792194:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e95a07d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792202:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e95a07d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792226:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a084 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792234:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792240:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864915.792272:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788864915.792275:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788864915.792284:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792291:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95a076 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792296:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95a076 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792301:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95a076 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792304:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864915.792307:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95a076 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792317:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95a076 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792326:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fdca4f57c00) 00010000:00010000:1.0:1788864915.792328:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864915.792331:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95a076 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792335:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95a076 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792344:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e95a07d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792347:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e95a07d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792352:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e95a07d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792355:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864915.792358:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e95a07d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792363:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e95a07d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792369:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9fdc8328ef00) 00010000:00010000:1.0:1788864915.792372:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864915.792374:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e95a07d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792389:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e95a07d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792404:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792411:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a084 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792417:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a084 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792422:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864915.792426:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a084 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792437:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a084 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792445:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:1.0:1788864915.792447:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864915.792450:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a084 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.792456:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a084 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864915.792614:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+61:11632:x1875760528844032:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 562us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864915.792622:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 215 00000100:00100000:3.0:1788864915.807171:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864915.807257:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528844288 00000100:00100000:1.0:1788864915.807268:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528844288 00000100:00100000:1.0:1788864915.807329:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 216 00000100:00100000:1.0:1788864915.807339:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+61:11632:x1875760528844288:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788864915.807358:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864915.807378:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a08b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fe44 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.807470:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e95a092 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.807484:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e95a092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.807496:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e95a092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864915.807505:0:6705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788864915.807602:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e95a092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.807609:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e95a092 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.807615:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e95a092 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.807620:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864915.807624:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e95a092 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.807632:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e95a092 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.807652:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:1.0:1788864915.807654:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788864915.807659:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e95a092 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.807665:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e95a092 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.807701:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a08b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe44 expref: 63 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.807746:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fdca4f57c00) 00010000:00010000:1.0:1788864915.807748:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788864915.807753:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a08b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe44 expref: 63 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.807763:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc74000, rc 0) 00000100:00100000:1.0:1788864915.807820:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+62:11632:x1875760528844288:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 483us (658us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1788864915.807828:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 216 00000100:00100000:3.0:1788864915.810197:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864915.810268:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528844416 00000100:00100000:0.0:1788864915.810276:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528844416 00000100:00100000:0.0:1788864915.810331:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 217 00000100:00100000:0.0:1788864915.810340:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+62:11632:x1875760528844416:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788864915.810374:0:5836:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788864915.810487:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+62:11632:x1875760528844416:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 147us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864915.810495:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 217 00000100:00100000:2.0:1788864915.824372:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864915.824755:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528844672 00000100:00100000:1.0:1788864915.824766:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528844672 00000100:00100000:1.0:1788864915.824828:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 218 00000100:00100000:1.0:1788864915.824837:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+62:11632:x1875760528844672:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788864915.824866:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864915.824869:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788864915.824894:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95a030 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe28 expref: 62 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.824932:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:1.0:1788864915.824936:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788864915.824949:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a0a0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fe4b expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788864915.825303:0:6705:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:1.0:1788864915.825496:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e95a0a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.825510:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e95a0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.825520:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e95a0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.825571:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a0a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe4b expref: 64 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.825585:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e95a0a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe4b expref: 63 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.825592:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fdc8328ef00) 00010000:00010000:1.0:1788864915.825594:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788864915.825596:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc75400, rc 0) 00000100:00100000:1.0:1788864915.825661:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+63:11632:x1875760528844672:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 825us (1299us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788864915.825669:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 218 00000100:00100000:3.0:1788864915.831517:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864915.831912:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528844928 00000100:00100000:0.0:1788864915.831922:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528844928 00000100:00100000:0.0:1788864915.831993:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 219 00000100:00100000:0.0:1788864915.832004:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+63:11632:x1875760528844928:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788864915.832064:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864915.832090:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75400/0xf8c13e2d0e95a0a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe4b expref: 63 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.832110:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fdc8328ef00) 00010000:00010000:0.0:1788864915.832121:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788864915.832143:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e95a0b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.832156:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e95a0b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.832165:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e95a0b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.832180:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a0bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x4a898f49 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.832188:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a0bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4a898f49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.832194:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a0bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4a898f49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.832270:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e95a0b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.832277:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e95a0b5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.832283:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e95a0b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.832288:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4ac00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864915.832292:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e95a0b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.832299:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e95a0b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.832306:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:0.0:1788864915.832309:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864915.832312:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e95a0b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.832317:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e95a0b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.832326:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a0bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4a898f49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.832331:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a0bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4a898f49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.832336:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a0bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4a898f49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.832346:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864915.832349:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a0bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4a898f49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.832368:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a0bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4a898f49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.832376:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x4a898f49 (ffff9fdca4f57a00) 00010000:00010000:0.0:1788864915.832379:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864915.832381:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a0bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x4a898f49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.832387:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a0bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x4a898f49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864915.832469:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+62:11632:x1875760528844928:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 466us (960us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788864915.832477:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 219 00000100:00100000:3.0:1788864915.839916:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864915.839992:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528845056 00000100:00100000:1.0:1788864915.840002:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528845056 00000100:00100000:1.0:1788864915.840063:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 220 00000100:00100000:1.0:1788864915.840073:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+62:11632:x1875760528845056:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788864915.840092:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864915.840114:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a0c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fe52 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.840148:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95a0ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.840162:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95a0ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.840173:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95a0ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.840265:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a0c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe52 expref: 64 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.840280:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95a0ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe52 expref: 63 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.840288:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fdc8328e700) 00010000:00010000:1.0:1788864915.840291:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788864915.840295:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc75200, rc 0) 00000100:00100000:1.0:1788864915.840361:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+63:11632:x1875760528845056:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 281us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864915.840367:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 220 00000100:00100000:2.0:1788864915.844800:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864915.844883:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528845312 00000100:00100000:0.0:1788864915.844893:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528845312 00000100:00100000:0.0:1788864915.844961:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 221 00000100:00100000:0.0:1788864915.844971:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+63:11632:x1875760528845312:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788864915.845061:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a0d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.845077:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a0d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.845089:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a0d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788864915.845330:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:0.0:1788864915.845429:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ef94c64 reply state 00000000854bb7fc transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a0d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864915.845439:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788864915.845540:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+65:11632:x1875760528845312:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 569us (747us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1788864915.845548:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 221 00010000:00010000:2.0:1788864915.851678:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a0d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.851745:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a0d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.851753:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a0d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.851759:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788864915.851763:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a0d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.851771:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a0d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.851788:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fdc8328e700) 00010000:00010000:2.0:1788864915.851791:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788864915.851795:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a0d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.851802:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a000/0xf8c13e2d0e95a0d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864915.853773:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864915.853846:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528845440 00000100:00100000:1.0:1788864915.853868:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528845440 00000100:00100000:1.0:1788864915.853935:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 222 00000100:00100000:1.0:1788864915.853945:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+64:11632:x1875760528845440:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788864915.853973:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864915.854007:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a0d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fe59 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.854060:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a0d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe59 expref: 65 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.854073:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a0d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe59 expref: 65 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864915.854090:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fdc8328e700) 00010000:00010000:1.0:1788864915.854093:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788864915.854096:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc74000, rc 0) 00000100:00100000:1.0:1788864915.854157:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+65:11632:x1875760528845440:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 213us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864915.854164:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 222 00000100:00100000:3.0:1788864915.858876:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864915.858964:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528845568 00000100:00100000:1.0:1788864915.858975:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528845568 00000100:00100000:1.0:1788864915.859049:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:1.0:1788864915.859059:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:2358:x1875760528845568:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788864915.859339:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+10:2358:x1875760528845568:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 281us (471us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788864915.859347:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00080000:0.0:1788864915.859539:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788864915.861250:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864915.861345:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528845824 00000100:00100000:2.0:1788864915.861354:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528845824 00000100:00100000:2.0:1788864915.861404:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:2.0:1788864915.861414:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+65:11632:x1875760528845824:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788864915.861638:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+66:11632:x1875760528845824:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 224us (390us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788864915.861646:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:2.0:1788864915.865643:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864915.866175:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528846080 00000100:00100000:0.0:1788864915.866185:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528846080 00000100:00100000:0.0:1788864915.866292:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 223 00000100:00100000:0.0:1788864915.866303:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+66:11632:x1875760528846080:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788864915.866412:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+66:11632:x1875760528846080:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 111us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864915.866420:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 223 00000100:00100000:3.0:1788864915.872658:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864915.873032:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528846208 00000100:00100000:0.0:1788864915.873042:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528846208 00000100:00100000:0.0:1788864915.873150:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 224 00000100:00100000:0.0:1788864915.873161:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+66:11632:x1875760528846208:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788864915.873183:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864915.873202:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e95a0df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fe60 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.873276:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a0e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.873309:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.873369:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864915.873414:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788864915.873430:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.873467:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ac00/0xf8c13e2d0e95a0df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe60 expref: 68 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.873483:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a0e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe60 expref: 67 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.873491:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fdc8328e700) 00010000:00010000:0.0:1788864915.873493:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788864915.873497:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4ba00, rc 0) 00000100:00100000:0.0:1788864915.873564:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+67:11632:x1875760528846208:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 405us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864915.873572:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 224 00000100:00100000:3.0:1788864915.878482:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864915.878571:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528846336 00000100:00100000:2.0:1788864915.878581:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528846336 00000100:00100000:2.0:1788864915.878668:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:2.0:1788864915.878679:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+10:2359:x1875760528846336:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788864915.878695:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864915.878747:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e95a0ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fe67 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788864915.878773:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fe993, blocks: 0x1 00010000:00010000:2.0:1788864915.878791:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1788864915.878795:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864915.878804:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e95a0ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe67 expref: 11 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.878821:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e95a0ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe67 expref: 11 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864915.878834:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384e00, rc 0) 00000100:00100000:2.0:1788864915.878901:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+11:2359:x1875760528846336:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 223us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864915.878908:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:2.0:1788864915.887611:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864915.887697:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528846592 00000100:00100000:1.0:1788864915.887730:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528846592 00000100:00100000:1.0:1788864915.887779:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 225 00000100:00100000:1.0:1788864915.887790:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+67:11632:x1875760528846592:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788864915.887910:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+67:11632:x1875760528846592:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 121us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864915.887918:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 225 00000100:00100000:0.0:1788864915.896639:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864915.896773:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528846720 00000100:00100000:3.0:1788864915.896784:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528846720 00000100:00100000:3.0:1788864915.896862:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:3.0:1788864915.896873:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+11:11632:x1875760528846720:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788864915.896891:0:8199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864915.896909:0:8199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000521b604b/0xf8c13e2d0e95a0f4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fe6e expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.896941:0:8199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e95a0ed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe67 expref: 12 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.896951:0:8199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788864915.896956:0:8199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788864915.896961:0:8199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000521b604b/0xf8c13e2d0e95a0f4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe6e expref: 12 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.896996:0:8199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e95a0ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe67 expref: 12 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.897042:0:8199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e95a0ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe67 expref: 12 pid: 6682 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864915.897057:0:8199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcafca1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8199:1875760546654976:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788864915.897167:0:8199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfdbeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788864915.900304:0:8199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcafca1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8199:1875760546654976:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788864915.900357:0:8199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000521b604b/0xf8c13e2d0e95a0f4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe6e expref: 12 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.900405:0:8199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcc2045600, rc 0) 00000100:00100000:0.0:1788864915.900462:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+12:11632:x1875760528846720:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 3590us (3831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864915.900471:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:2.0:1788864915.902644:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864915.902806:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528846848 00000100:00100000:3.0:1788864915.902816:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528846848 00010000:00010000:3.0:1788864915.902862:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e95a0ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe67 expref: 12 pid: 6682 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864915.902902:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:3.0:1788864915.902912:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+12:2358:x1875760528846848:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788864915.902929:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864915.902952:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e95a0ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe67 expref: 12 pid: 6682 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.902965:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e95a0ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe67 expref: 12 pid: 6682 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.902988:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e95a0ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe67 expref: 12 pid: 6682 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.903005:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788864915.903021:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788864915.903030:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000521b604b/0xf8c13e2d0e95a0f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe6e expref: 11 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.903040:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000521b604b/0xf8c13e2d0e95a0f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe6e expref: 11 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.903076:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000521b604b/0xf8c13e2d0e95a0f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe6e expref: 11 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864915.903089:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcafca0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5820:1875760546655104:192.168.203.13@tcp:105: 00000100:00100000:3.0:1788864915.903166:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfdbe780 going to sleep for 11 seconds 00000100:00100000:3.0:1788864915.908696:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864915.908916:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528846976 00000100:00100000:0.0:1788864915.908925:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528846976 00002000:00100000:0.0:1788864915.908972:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9fdcafca1c00 x1875760528846976/t0(0) o4->1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp:391/0 lens 504/0 e 0 to 0 dl 1788864926 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788864915.908984:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fdcafca1c00 with x1875760528846976 ext(0->12) 00002000:00010000:0.0:1788864915.908990:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fdcafca1c00 00000100:00100000:0.0:1788864915.909056:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:0.0:1788864915.909066:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+12:2358:x1875760528846976:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788864915.909072:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcafca0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5820:1875760546655104:192.168.203.13@tcp:105: 00010000:00010000:1.0:1788864915.909092:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864915.909157:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+12:2358:x1875760528846848:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 6240us (6512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864915.909166:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:0.0:1788864915.909618:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+13:2358:x1875760528846976:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 Request processed in 553us (929us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788864915.909626:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00002000:00100000:0.0:1788864915.909633:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9fdcafca1c00 x1875760528846976/t4294967320(0) o4->1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp:391/0 lens 504/448 e 0 to 0 dl 1788864926 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788864915.909641:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fdcafca1c00 with x1875760528846976 ext(0->12) 00002000:00010000:0.0:1788864915.909645:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fdcafca1c00 00000100:00100000:0.0:1788864915.912680:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864915.912822:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528847104 00000100:00100000:1.0:1788864915.912833:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528847104 00000100:00100000:1.0:1788864915.912932:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 226 00000100:00100000:1.0:1788864915.912942:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+67:11632:x1875760528847104:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788864915.970109:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000020:00080000:1.0:1788864915.970147:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fdcc0598600 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788864915.970152:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fdcbff13200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fdcc0598a80 00000020:00080000:1.0:1788864915.970155:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fdcbff13a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fdcac9c4400 00000020:00080000:1.0:1788864915.970167:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:1.0:1788864915.970179:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:1.0:1788864915.970208:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1788864915.970232:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1788864915.970246:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fdcbfdbe0c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788864915.970249:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fdca2d47600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fdcbfdbe600 00000020:00080000:1.0:1788864915.970265:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fdca2d47100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fdcacbd4c00 00000020:00080000:1.0:1788864915.970295:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:0.0:1788864915.970578:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+21:11632:x1875760528847104:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 57632us (57898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864915.970588:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 226 00000100:00100000:0.0:1788864915.970880:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc86e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546655232:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788864915.970932:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864915.970994:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546655232 00000100:00100000:0.0:1788864915.971001:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546655232 00000100:00100000:0.0:1788864915.971048:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788864915.971056:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1875760546655232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788864915.971081:0:6684:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1788864915.971108:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6036fb/0xf8c13e2d0e95a0fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.971129:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e959ebd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdcd expref: 12 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.971137:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788864915.971141:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788864915.971146:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6036fb/0xf8c13e2d0e95a0fb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.971172:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e959ebd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdcd expref: 12 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.971187:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e959ebd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdcd expref: 12 pid: 8199 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864915.971198:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc86f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1875760546655360:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788864915.971240:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598300 going to sleep for 11 seconds 00000100:00080000:0.0:1788864915.971258:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788864915.971361:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546655488:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788864915.971403:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864915.971444:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546655488 00000100:00100000:0.0:1788864915.971449:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546655488 00000100:00100000:0.0:1788864915.971472:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788864915.971478:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3300:x1875760546655488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788864915.971490:0:6685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1788864915.971515:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9fe992, atime: 0x6a9fe992, ctime: 0x6a9fe992, blocks: 0x1 00010000:00010000:0.0:1788864915.971521:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000776de0e4/0xf8c13e2d0e95a102 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.971530:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788864915.971533:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788864915.971539:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000776de0e4/0xf8c13e2d0e95a102 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.971552:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000776de0e4/0xf8c13e2d0e95a102 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.971562:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000776de0e4/0xf8c13e2d0e95a102 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.971568:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000776de0e4/0xf8c13e2d0e95a102 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.971584:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788864915.972155:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3300:x1875760546655488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 674us (749us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788864915.972163:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:0.0:1788864915.972210:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fdcbc86c380/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788864915.972217:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546655488:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788864915.972240:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864915.972246:0:11155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000776de0e4/0xf8c13e2d0e95a102 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.972255:0:11155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4b400 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788864915.972260:0:11155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000776de0e4/0xf8c13e2d0e95a102 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.972270:0:11155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000776de0e4/0xf8c13e2d0e95a102 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.972286:0:11155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000776de0e4/0xf8c13e2d0e95a102 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.972294:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000776de0e4/0xf8c13e2d0e95a102 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.972313:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864915.972314:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864915.972316:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788864915.973576:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788864915.975163:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864915.975243:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528847232 00000100:00100000:2.0:1788864915.975253:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528847232 00000100:00100000:2.0:1788864915.975307:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:2.0:1788864915.975330:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+13:2358:x1875760528847232:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788864915.987469:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864915.988282:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc86f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1875760546655360:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788864915.988309:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d6036fb/0xf8c13e2d0e95a0fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864915.989157:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528847360 00000100:00100000:3.0:1788864915.989168:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528847360 00010000:00010000:3.0:1788864915.989206:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e959ebd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdcd expref: 14 pid: 8199 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864915.989237:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:3.0:1788864915.989248:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+14:2358:x1875760528847360:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788864915.989262:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864915.989268:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e959ebd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdcd expref: 14 pid: 8199 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.989282:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e959ebd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdcd expref: 14 pid: 8199 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.989322:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e959ebd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdcd expref: 14 pid: 8199 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.989338:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788864915.989342:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788864915.989348:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d6036fb/0xf8c13e2d0e95a0fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.989371:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6036fb/0xf8c13e2d0e95a0fb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.989501:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788864915.989557:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+13:2358:x1875760528847360:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 310us (2096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864915.989565:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 80 00010000:00010000:0.0:1788864915.990038:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d6036fb/0xf8c13e2d0e95a0fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.990049:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6036fb/0xf8c13e2d0e95a0fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.990059:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6036fb/0xf8c13e2d0e95a0fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.990067:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6036fb/0xf8c13e2d0e95a0fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864915.990091:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788864915.990884:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1875760546655232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19826us (19949us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788864915.990896:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:0.0:1788864915.990952:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fdcbc86e680/2, rc 0, transno 4294967321 00000100:00100000:0.0:1788864915.990965:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc86e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546655232:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788864915.991206:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788864915.991215:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6036fb/0xf8c13e2d0e95a0fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.991225:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a800 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:3.0:1788864915.991229:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6036fb/0xf8c13e2d0e95a0fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.991239:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6036fb/0xf8c13e2d0e95a0fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.991269:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6036fb/0xf8c13e2d0e95a0fb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.991276:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6036fb/0xf8c13e2d0e95a0fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864915.991295:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864915.991297:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864915.991298:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864916.025039:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+12:2358:x1875760528847232:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 49700us (49874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864916.025053:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 67 00000001:00080000:0.0:1788864916.025860:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:0.0:1788864916.025876:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000100:00100000:0.0:1788864916.029894:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864916.030138:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528847616 00000100:00100000:1.0:1788864916.030149:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528847616 00000100:00100000:1.0:1788864916.030316:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 227 00000100:00100000:1.0:1788864916.030328:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+21:11632:x1875760528847616:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788864916.030442:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864916.030470:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a0e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe60 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.030491:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fdc8328e700) 00010000:00010000:1.0:1788864916.030503:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788864916.030533:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95a109 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.030556:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95a109 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.030567:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95a109 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788864916.030821:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:2.0:1788864916.031579:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e22bc398 reply state 000000009cb6e62f transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95a109 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864916.031592:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788864916.031783:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+22:11632:x1875760528847616:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 1456us (1897us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788864916.031791:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 227 00010000:00010000:1.0:1788864916.034883:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95a109 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.035072:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95a109 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.035081:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95a109 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.035086:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788864916.035090:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95a109 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.035098:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95a109 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.035115:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fdc8328e700) 00010000:00010000:1.0:1788864916.035118:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864916.035123:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95a109 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.035128:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75600/0xf8c13e2d0e95a109 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864916.037753:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864916.038975:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864916.039120:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528847744 00000100:00100000:2.0:1788864916.039130:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528847744 00000100:00100000:2.0:1788864916.039194:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:2.0:1788864916.039205:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2359:x1875760528847744:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788864916.039406:0:8199:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788864916.039410:0:8199:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788864915 00002000:00010000:2.0:1788864916.039412:0:8199:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788864914 00002000:00010000:2.0:1788864916.039414:0:8199:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788864915 -> 1788864915 00002000:00010000:2.0:1788864916.039417:0:8199:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788864916.039478:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2359:x1875760528847744:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 274us (509us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788864916.039485:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:2.0:1788864916.048861:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864916.048953:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528848000 00000100:00100000:0.0:1788864916.048964:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528848000 00000100:00100000:0.0:1788864916.049026:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 228 00000100:00100000:0.0:1788864916.049037:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+21:11632:x1875760528848000:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788864916.049135:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a110 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.049153:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95a0ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe52 expref: 21 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.049163:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a110 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.049200:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95a0ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe52 expref: 21 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.049213:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95a0ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe52 expref: 21 pid: 6705 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864916.049229:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc86d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875760546655616:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788864916.049326:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598240 going to sleep for 11 seconds 00000100:00100000:2.0:1788864916.056832:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864916.056979:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528848128 00000100:00100000:1.0:1788864916.056988:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528848128 00010000:00010000:1.0:1788864916.057073:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95a0ca lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe52 expref: 22 pid: 6705 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864916.057128:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:1.0:1788864916.057140:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc858380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+22:2358:x1875760528848128:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864916.057154:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864916.057169:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95a0ca lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe52 expref: 22 pid: 6705 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.057183:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95a0ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe52 expref: 22 pid: 6705 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.057205:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fdc8328e700) 00010000:00010000:1.0:1788864916.057210:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a110 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.057220:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a110 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.057228:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a110 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.057254:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864916.057319:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc858380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+22:2358:x1875760528848128:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 181us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864916.057327:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 81 00010000:00010000:0.0:1788864916.058261:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75200/0xf8c13e2d0e95a0ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe52 expref: 21 pid: 6705 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864916.058282:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc86d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875760546655616:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788864916.058308:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a110 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.058318:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a110 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.058323:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a110 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.058364:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a110 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.058371:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a110 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.058378:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a110 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.058383:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4b400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864916.058387:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a110 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.058394:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a110 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.058406:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fdc8328e700) 00010000:00010000:0.0:1788864916.058408:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788864916.058413:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a110 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.058419:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a110 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864916.058591:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+20:11632:x1875760528848000:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 Request processed in 9555us (9748us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788864916.058600:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 228 00000100:00100000:2.0:1788864916.063526:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864916.063573:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528848256 00000100:00100000:0.0:1788864916.063583:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528848256 00000100:00100000:0.0:1788864916.063636:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:0.0:1788864916.063659:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc85b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2359:x1875760528848256:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788864916.063748:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e95a117 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.063767:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000521b604b/0xf8c13e2d0e95a0f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe6e expref: 8 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.063776:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788864916.063780:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788864916.063785:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e95a117 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.063818:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000521b604b/0xf8c13e2d0e95a0f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe6e expref: 8 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.063831:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000521b604b/0xf8c13e2d0e95a0f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe6e expref: 8 pid: 8199 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864916.063845:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc86d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1875760546655744:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788864916.063931:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598240 going to sleep for 11 seconds 00000100:00100000:2.0:1788864916.072772:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864916.073273:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528848384 00000100:00100000:1.0:1788864916.073293:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528848384 00010000:00010000:1.0:1788864916.073337:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000521b604b/0xf8c13e2d0e95a0f4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe6e expref: 9 pid: 8199 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864916.073392:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:1.0:1788864916.073403:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:2359:x1875760528848384:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864916.073417:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864916.073441:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000521b604b/0xf8c13e2d0e95a0f4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe6e expref: 9 pid: 8199 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.073468:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000521b604b/0xf8c13e2d0e95a0f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe6e expref: 9 pid: 8199 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.073492:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788864916.073497:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788864916.073503:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e95a117 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.073515:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e95a117 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.073541:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864916.073603:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+9:2359:x1875760528848384:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 201us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864916.073611:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 82 00010000:00010000:0.0:1788864916.076011:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000521b604b/0xf8c13e2d0e95a0f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe6e expref: 8 pid: 8199 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864916.076038:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc86d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1875760546655744:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788864916.076064:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e95a117 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.076091:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e95a117 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.076098:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e95a117 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.076145:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e95a117 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.076154:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e95a117 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.076162:0:6684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e95a117 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.076170:0:6684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4b400 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788864916.076175:0:6684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e95a117 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.076184:0:6684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e95a117 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.076202:0:6684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e95a117 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.076221:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000776de0e4/0xf8c13e2d0e95a117 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864916.076308:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc85b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2359:x1875760528848256:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 12651us (12791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864916.076318:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:2.0:1788864916.079226:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864916.079379:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528848640 00000100:00100000:3.0:1788864916.079390:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528848640 00000100:00100000:3.0:1788864916.079451:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 229 00000100:00100000:3.0:1788864916.079462:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc062a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+20:11632:x1875760528848640:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788864916.079559:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044000/0xf8c13e2d0e95a11e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864916.079577:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044000/0xf8c13e2d0e95a11e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864916.079590:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044000/0xf8c13e2d0e95a11e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864916.080165:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a125 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864916.080181:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a0d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe59 expref: 21 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864916.080190:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a125 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864916.080226:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a0d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe59 expref: 21 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864916.080242:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a0d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe59 expref: 21 pid: 6705 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864916.080256:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc824380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875760546655872:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788864916.080383:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1e35f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788864916.087925:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864916.088049:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc824380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875760546655872:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788864916.088076:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a125 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864916.090618:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528848768 00000100:00100000:0.0:1788864916.090632:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528848768 00010000:00010000:2.0:1788864916.090872:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a0d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe59 expref: 22 pid: 6705 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864916.090968:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:2.0:1788864916.090980:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+22:2359:x1875760528848768:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788864916.091007:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864916.091015:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a0d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe59 expref: 22 pid: 6705 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864916.091029:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a0d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe59 expref: 22 pid: 6705 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864916.091051:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74000/0xf8c13e2d0e95a0d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe59 expref: 22 pid: 6705 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864916.091069:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fdc8328e700) 00010000:00010000:2.0:1788864916.091074:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a125 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864916.091084:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a125 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864916.091092:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a125 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864916.092646:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864916.092754:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+21:2359:x1875760528848768:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 1772us (4835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864916.092767:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 83 00010000:00010000:0.0:1788864916.093941:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a125 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.093954:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a125 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788864916.094163:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1788864916.094318:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1788864916.094368:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1788864916.094452:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc86d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5836:1875760546656000:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788864916.094510:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864916.094552:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788864916.094821:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546656000 00000100:00100000:3.0:1788864916.094829:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546656000 00000100:00100000:3.0:1788864916.094885:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788864916.094894:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1875760546656000:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788864916.094997:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1875760546656000:12345-0@lo:1000:mdt00_001.0 Request processed in 105us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864916.095005:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788864916.095131:0:5836:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:0.0:1788864916.095137:0:5836:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:0.0:1788864916.095157:0:5836:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9fdcbc86e680 x1875760546655232/t4294967321(4294967321) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788864931 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864916.095169:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc86d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5836:1875760546656000:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788864916.095582:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1788864916.095646:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc86d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5836:1875760546656128:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788864916.095691:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864916.095740:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598240 going to sleep for 11 seconds 00000100:00100000:3.0:1788864916.095917:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546656128 00000100:00100000:3.0:1788864916.095922:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546656128 00000100:00100000:3.0:1788864916.095967:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788864916.095975:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1875760546656128:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788864916.096155:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5836:x1875760546656128:12345-0@lo:1000:mdt00_001.0 Request processed in 181us (463us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788864916.096163:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788864916.096481:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc86d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5836:1875760546656128:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788864916.096514:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a125 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.096525:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a125 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.096533:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a125 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.096539:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864916.096545:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a125 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.096552:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a125 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.096568:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fdc8328e700) 00010000:00010000:0.0:1788864916.096571:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788864916.096576:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a125 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.096582:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a125 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.096611:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e95a068 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.096618:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e95a068 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.096635:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e95a068 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.096640:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864916.096643:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e95a068 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.096649:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e95a068 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.096659:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:0.0:1788864916.096661:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788864916.096668:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e95a06f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe3d expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.096780:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e95a06f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe3d expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.096790:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e95a06f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe3d expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.096818:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e95a06f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe3d expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864916.096830:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc86f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875760546656256:192.168.203.13@tcp:105: 00000100:00100000:0.0:1788864916.097085:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcc0598240 going to sleep for 11 seconds 00000100:00100000:0.0:1788864916.101944:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc86f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875760546656256:192.168.203.13@tcp:105: 00000100:00100000:3.0:1788864916.101993:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00010000:00010000:0.0:1788864916.101996:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e95a068 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.102009:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75000/0xf8c13e2d0e95a068 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.102044:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a12c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.102059:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a12c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.102071:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a12c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.102082:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a12c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.102087:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a12c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.102094:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a12c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.102099:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4b400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864916.102104:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a12c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.102111:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a12c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.102134:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:0.0:1788864916.102137:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864916.102147:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a12c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.102154:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b400/0xf8c13e2d0e95a12c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.102166:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044000/0xf8c13e2d0e95a11e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.102173:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044000/0xf8c13e2d0e95a11e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.102179:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044000/0xf8c13e2d0e95a11e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.102184:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc2044000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864916.102186:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044000/0xf8c13e2d0e95a11e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.102192:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044000/0xf8c13e2d0e95a11e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.102200:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:0.0:1788864916.102203:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788864916.102205:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044000/0xf8c13e2d0e95a11e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.102211:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2044000/0xf8c13e2d0e95a11e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864916.102449:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc062a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+24:11632:x1875760528848640:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 22987us (23229us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1788864916.102460:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 229 00000020:00080000:0.0:1788864916.102473:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788864916.102553:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788864916.102559:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788864916.103138:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788864916.103147:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788864916.104498:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528848896 00000100:00100000:2.0:1788864916.104510:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528848896 00000100:00100000:2.0:1788864916.104573:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:2.0:1788864916.104585:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+24:11631:x1875760528848896:12345-192.168.203.13@tcp:49:lfs.0 00000100:00100000:2.0:1788864916.104762:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+24:11631:x1875760528848896:12345-192.168.203.13@tcp:49:lfs.0 Request processed in 178us (2771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864916.104770:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:3.0:1788864916.115189:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864916.115259:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864916.115385:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528849152 00000100:00100000:1.0:1788864916.115394:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528849152 00000100:00100000:1.0:1788864916.115457:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 230 00000100:00100000:1.0:1788864916.115468:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+24:11631:x1875760528849152:12345-192.168.203.13@tcp:58:lfs.0 00000040:00080000:1.0:1788864916.115883:0:6705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788864916.115924:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528849408 00000100:00100000:0.0:1788864916.115931:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528849408 00000100:00100000:0.0:1788864916.115966:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:1.0:1788864916.115975:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+25:11631:x1875760528849152:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 507us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864916.115978:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca21f6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+25:11632:x1875760528849408:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788864916.115999:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 230 00000004:00080000:0.0:1788864916.116506:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788864916.116622:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1788864916.116667:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e95a133 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.116685:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e95a133 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.116698:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e95a133 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.116746:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e95a133 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.116753:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e95a133 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.116759:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e95a133 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864916.116774:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788864916.116840:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca21f6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+26:11632:x1875760528849408:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 864us (1578us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788864916.116859:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00000020:00080000:0.0:1788864916.116863:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788864916.117012:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788864916.117020:0:11155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e95a133 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.117028:0:11155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4ae00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788864916.117033:0:11155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e95a133 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.117042:0:11155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e95a133 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.117056:0:11155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fdca4f57a00) 00010000:00010000:1.0:1788864916.117059:0:11155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788864916.117065:0:11155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e95a133 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.117071:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e95a133 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.117087:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864916.117089:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864916.117091:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864916.187959:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864916.188035:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528849536 00000100:00100000:2.0:1788864916.188046:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528849536 00000100:00100000:2.0:1788864916.188106:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 231 00000100:00100000:2.0:1788864916.188117:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+26:11634:x1875760528849536:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788864916.188139:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864916.188159:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e95a13a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fe75 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864916.188218:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e95a141 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864916.188232:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e95a141 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864916.188243:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e95a141 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864916.188256:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a148 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864916.188263:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864916.188270:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864916.188518:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a14f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864916.188538:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e95a05a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe36 expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864916.188546:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a14f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864916.188579:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e95a05a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe36 expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864916.188593:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e95a05a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe36 expref: 27 pid: 5837 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864916.188607:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc824380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875760546656384:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788864916.188746:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1e35f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788864916.191612:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864916.191612:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc824380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875760546656384:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788864916.191643:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a14f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864916.192257:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528849792 00000100:00100000:0.0:1788864916.192278:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528849792 00000100:00100000:0.0:1788864916.192389:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:0.0:1788864916.192401:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+28:5595:x1875760528849792:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788864916.192639:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+29:5595:x1875760528849792:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 239us (1030us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1788864916.192647:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:3.0:1788864916.201125:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864916.201220:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528849920 00000100:00100000:1.0:1788864916.201230:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528849920 00010000:00010000:1.0:1788864916.201270:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e95a05a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe36 expref: 29 pid: 5837 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864916.201312:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:1.0:1788864916.201323:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+29:2359:x1875760528849920:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788864916.201350:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864916.201358:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e95a05a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe36 expref: 29 pid: 5837 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.201371:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e95a05a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe36 expref: 29 pid: 5837 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.201391:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e95a05a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe36 expref: 29 pid: 5837 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.201405:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:1.0:1788864916.201410:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a14f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.201420:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a14f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.201427:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a14f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864916.201465:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864916.201520:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+28:2359:x1875760528849920:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 200us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864916.201527:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 84 00010000:00010000:3.0:1788864916.201632:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a14f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864916.201641:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a14f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788864916.201691:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788864916.201695:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788864916.201744:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a14f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864916.202053:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a14f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864916.202078:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e95a141 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864916.202085:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e95a141 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864916.202091:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e95a141 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864916.202097:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864916.202101:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e95a141 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864916.202109:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e95a141 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864916.202120:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:3.0:1788864916.202122:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864916.202126:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e95a141 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864916.202131:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385200/0xf8c13e2d0e95a141 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864916.202143:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864916.202149:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a148 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864916.202154:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864916.202166:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864916.202169:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864916.202175:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a148 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864916.202183:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fdc9124e300) 00010000:00010000:3.0:1788864916.202185:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864916.202188:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a148 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864916.202194:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a148 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864916.202229:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385600/0xf8c13e2d0e95a13a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe75 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864916.202243:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a14f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe75 expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864916.202249:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:3.0:1788864916.202252:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788864916.202254:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385000, rc 0) 00000100:00100000:3.0:1788864916.202285:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+27:11634:x1875760528849536:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 14171us (14336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864916.202292:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 231 00010000:00010000:3.0:1788864917.060827:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788864917.125603:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788864917.125611:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788864917.125668:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788864917.125675:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788864917.125955:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc86f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1875760546656512:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788864917.129415:0:11671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc84e8fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788864917.134332:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864917.134680:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528850048 00000100:00100000:2.0:1788864917.134689:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528850048 00000100:00100000:2.0:1788864917.134935:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 232 00000100:00100000:2.0:1788864917.134946:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+28:11645:x1875760528850048:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788864917.134977:0:6705:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788864917.134980:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc86f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11671:1875760546656512:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788864917.135074:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+27:11645:x1875760528850048:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 130us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864917.135082:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 232 00000100:00100000:1.0:1788864917.145295:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864917.145422:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528850304 00000100:00100000:0.0:1788864917.145432:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528850304 00000100:00100000:0.0:1788864917.145494:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 233 00000100:00100000:0.0:1788864917.145503:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+27:11645:x1875760528850304:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788864917.145609:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864917.145630:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e95a156 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fe7c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864917.145755:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e95a15d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864917.145770:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e95a15d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864917.145782:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e95a15d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864917.145807:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788864917.145974:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4b600/0xf8c13e2d0e95a156 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe7c expref: 30 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864917.145992:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e95a15d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe7c expref: 29 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864917.146000:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:0.0:1788864917.146003:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788864917.146006:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4a400, rc 0) 00000100:00100000:0.0:1788864917.146069:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+29:11645:x1875760528850304:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 566us (783us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788864917.146076:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 233 00000100:00100000:1.0:1788864917.154150:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864917.154254:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528850432 00000100:00100000:3.0:1788864917.154264:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528850432 00000100:00100000:3.0:1788864917.154322:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:3.0:1788864917.154332:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81926680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+29:2358:x1875760528850432:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788864917.154347:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864917.154370:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a400/0xf8c13e2d0e95a15d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe7c expref: 29 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864917.154386:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:3.0:1788864917.154391:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788864917.154449:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81926680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+28:2358:x1875760528850432:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 119us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864917.154456:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:1.0:1788864917.155644:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864917.155832:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528850688 00000100:00100000:3.0:1788864917.155848:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528850688 00000100:00100000:3.0:1788864917.155897:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 234 00000100:00100000:3.0:1788864917.155906:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+28:11645:x1875760528850688:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788864917.155974:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e95a16b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864917.155989:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e95a16b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864917.156000:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e95a16b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864917.156160:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e95a16b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864917.156174:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e95a16b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864917.156181:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e95a16b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864917.156187:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc2045800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788864917.156191:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e95a16b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864917.156198:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e95a16b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864917.156209:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:3.0:1788864917.156212:0:6705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788864917.156229:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e95a16b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864917.156236:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcc2045800/0xf8c13e2d0e95a16b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864917.156357:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+29:11645:x1875760528850688:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 452us (717us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788864917.156364:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 234 00000040:00080000:1.0:1788864917.156489:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788864917.156494:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788864917.157027:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788864917.157037:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788864917.161456:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864917.161509:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528850944 00000100:00100000:1.0:1788864917.161519:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528850944 00000100:00100000:1.0:1788864917.161582:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:1.0:1788864917.161593:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+29:11645:x1875760528850944:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788864917.161863:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+30:11645:x1875760528850944:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 271us (417us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788864917.161871:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00000040:00080000:0.0:1788864917.174805:0:12494:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788864917.174814:0:12494:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788864917.174867:0:12494:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788864917.174873:0:12494:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788864917.401194:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864917.401664:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528851200 00000100:00100000:2.0:1788864917.401674:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528851200 00000100:00100000:2.0:1788864917.401981:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 235 00000100:00100000:2.0:1788864917.401993:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+30:11658:x1875760528851200:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788864917.402016:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864917.402036:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e95a172 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fe83 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864917.402133:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e95a179 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864917.402147:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e95a179 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864917.402160:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e95a179 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864917.402170:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788864917.402310:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385c00/0xf8c13e2d0e95a172 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe83 expref: 33 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864917.402329:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e95a179 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe83 expref: 32 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864917.402338:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:2.0:1788864917.402413:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788864917.402417:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384e00, rc 0) 00000100:00100000:2.0:1788864917.402480:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+32:11658:x1875760528851200:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 491us (1294us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788864917.402577:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 235 00000100:00100000:1.0:1788864917.412082:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864917.412252:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528851328 00000100:00100000:0.0:1788864917.412262:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528851328 00000100:00100000:0.0:1788864917.412316:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 236 00000100:00100000:0.0:1788864917.412325:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+32:11658:x1875760528851328:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:0.0:1788864917.412392:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e95a187 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864917.412408:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e95a187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864917.412434:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e95a187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864917.412460:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e95a187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864917.412467:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e95a187 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864917.412475:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e95a187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864917.412480:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4be00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788864917.412484:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e95a187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864917.412491:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e95a187 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864917.412501:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:0.0:1788864917.412505:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788864917.412510:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e95a187 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864917.412517:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4be00/0xf8c13e2d0e95a187 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864917.412585:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+32:11658:x1875760528851328:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 261us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864917.412592:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 236 00000100:00100000:1.0:1788864917.498536:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864917.501030:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528851456 00000100:00100000:2.0:1788864917.501045:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528851456 00000100:00100000:2.0:1788864917.501171:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:2.0:1788864917.501185:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2357:x1875760528851456:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:2.0:1788864917.501208:0:8199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864917.501227:0:8199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022890424/0xf8c13e2d0e95a18e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fe8a expref: -99 pid: 8199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788864917.501252:0:8199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9fe993, atime: 0x6a9fe992, ctime: 0x6a9fe993, blocks: 0xb 00010000:00010000:2.0:1788864917.501272:0:8199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=340s v=(0 0) 00010000:00010000:2.0:1788864917.501277:0:8199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864917.501285:0:8199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022890424/0xf8c13e2d0e95a18e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe8a expref: 8 pid: 8199 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864917.501302:0:8199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000022890424/0xf8c13e2d0e95a18e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe8a expref: 8 pid: 8199 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864917.501315:0:8199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385c00, rc 0) 00000100:00100000:2.0:1788864917.501393:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2357:x1875760528851456:12345-192.168.203.13@tcp:101:cat.0 Request processed in 213us (2866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864917.501401:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00080000:0.0:1788864917.501859:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788864917.510809:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864917.511029:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528851584 00000100:00100000:3.0:1788864917.511039:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528851584 00002000:00100000:3.0:1788864917.511087:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9fdb81927800 x1875760528851584/t0(0) o3->1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp:393/0 lens 488/0 e 0 to 0 dl 1788864928 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788864917.511099:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fdb81927800 with x1875760528851584 ext(0->4095) 00002000:00010000:3.0:1788864917.511114:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fdb81927800 00000100:00100000:3.0:1788864917.511152:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:3.0:1788864917.511162:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2356:x1875760528851584:12345-192.168.203.13@tcp:3:cat.0 00000100:00100000:3.0:1788864917.511346:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2356:x1875760528851584:12345-192.168.203.13@tcp:3:cat.0 Request processed in 179us (540us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788864917.511354:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00002000:00100000:3.0:1788864917.511360:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9fdb81927800 x1875760528851584/t0(0) o3->1cf2dd0f-7f2d-465e-9303-244222bc89bf@192.168.203.13@tcp:393/0 lens 488/4536 e 0 to 0 dl 1788864928 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788864917.511368:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fdb81927800 with x1875760528851584 ext(0->4095) 00002000:00010000:3.0:1788864917.511371:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fdb81927800 00000004:00080000:1.0:1788864917.830041:0:6889:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 340961334086ns, next at 341961331791ns, rc = 0 00000100:00100000:2.0:1788864917.830097:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788864917.830117:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546656640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788864917.830182:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864917.830302:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546656640 00000100:00100000:1.0:1788864917.830310:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546656640 00000100:00100000:1.0:1788864917.830382:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788864917.830391:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875760546656640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788864917.830410:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1788864917.830455:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875760546656640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864917.830462:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1788864917.830637:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788864917.830671:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546656640:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788864917.892434:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1788864917.892457:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:2.0:1788864918.084990:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864918.858557:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875760546656896:0@lo:400:kworker.0 00000100:00100000:1.0:1788864918.858619:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864918.858672:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc00ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546657408:0@lo:400:kworker.0 00000100:00100000:1.0:1788864918.858695:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864918.858738:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788864918.858743:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546656768:0@lo:400:kworker.0 00000100:00100000:1.0:1788864918.858766:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864918.858785:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc00ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875760546657280:0@lo:400:kworker.0 00000100:00100000:1.0:1788864918.858803:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864918.858824:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546657024:0@lo:400:kworker.0 00000100:00100000:1.0:1788864918.858856:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864918.858872:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788864918.858877:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546657152:0@lo:400:kworker.0 00000100:00100000:1.0:1788864918.858892:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864918.858922:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546656896 00000100:00100000:1.0:1788864918.858929:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546656896 00000100:00100000:1.0:1788864918.858966:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546657280 00000100:00100000:1.0:1788864918.858970:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546657280 00000100:00100000:1.0:1788864918.859001:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546657024 00000100:00100000:1.0:1788864918.859004:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546657024 00000100:00100000:1.0:1788864918.859019:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788864918.859026:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875760546656896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864918.859071:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875760546656896:12345-0@lo:400:kworker.0 Request processed in 46us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864918.859078:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788864918.859093:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788864918.859098:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875760546657280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864918.859119:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875760546657280:12345-0@lo:400:kworker.0 Request processed in 22us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864918.859133:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788864918.859144:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788864918.859149:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546657024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864918.859174:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546657024:12345-0@lo:400:kworker.0 Request processed in 25us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864918.859179:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788864918.859194:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546656768 00000100:00100000:1.0:1788864918.859196:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546656768 00000100:00100000:1.0:1788864918.859216:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788864918.859221:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3303:x1875760546656768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864918.859246:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3303:x1875760546656768:12345-0@lo:400:kworker.0 Request processed in 24us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864918.859252:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788864918.859278:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546657408 00000100:00100000:1.0:1788864918.859281:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546657408 00000100:00100000:1.0:1788864918.859303:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546657152 00000100:00100000:1.0:1788864918.859306:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546657152 00000100:00100000:1.0:1788864918.859321:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788864918.859327:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546657408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864918.859556:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546657408:12345-0@lo:400:kworker.0 Request processed in 229us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864918.859562:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788864918.859573:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788864918.859579:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3300:x1875760546657152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864918.859599:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3300:x1875760546657152:12345-0@lo:400:kworker.0 Request processed in 22us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864918.859613:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1788864918.859629:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788864918.859633:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788864918.859663:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546657152:0@lo:400:kworker.0 00000100:00100000:1.0:1788864918.859671:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546657024:0@lo:400:kworker.0 00000100:00100000:1.0:1788864918.859693:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546656768:0@lo:400:kworker.0 00000100:00100000:1.0:1788864918.859700:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc00ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875760546657280:0@lo:400:kworker.0 00000100:00100000:1.0:1788864918.859726:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875760546656896:0@lo:400:kworker.0 00000100:00100000:1.0:1788864918.859733:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788864918.859737:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fdcc07c7b80, transno 4294967307 00000004:00080000:1.0:1788864918.859747:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1788864918.859758:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fdcbc86c380, transno 4294967310 00000100:00100000:1.0:1788864918.859762:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc00ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546657408:0@lo:400:kworker.0 00010000:00010000:0.0:1788864919.115805:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864919.365202:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc00ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546657536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788864919.365270:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864919.366369:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546657536 00000100:00100000:1.0:1788864919.366380:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546657536 00000100:00100000:1.0:1788864919.366865:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788864919.366877:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546657536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788864919.366910:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788864919.366975:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546657536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864919.366982:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788864919.367301:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc00ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546657536:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788864920.132913:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864920.475984:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864920.476022:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864920.476103:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864920.476108:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528851712 00000100:00100000:2.0:1788864920.476125:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528851712 00000100:00100000:2.0:1788864920.476204:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 294 00000100:00100000:2.0:1788864920.476217:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+13:2359:x1875760528851712:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788864920.476332:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:202cc404-00bb-4314-9125-b9b0b45f494c+13:2359:x1875760528851712:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 107us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864920.476341:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 294 00000100:00100000:0.0:1788864920.476527:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528851968 00000100:00100000:0.0:1788864920.476535:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528851968 00000100:00100000:0.0:1788864920.476604:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:0.0:1788864920.476615:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2359:x1875760528851968:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788864920.476666:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+8:2359:x1875760528851968:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 55us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864920.476673:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00080000:0.0:1788864920.476768:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788864920.476787:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528852224 00000100:00100000:0.0:1788864920.476791:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528852224 00000100:00100000:0.0:1788864920.476845:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00100000:0.0:1788864920.476853:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2359:x1875760528852224:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788864920.476886:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2359:x1875760528852224:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 34us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864920.476892:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00080000:0.0:1788864920.476909:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788864920.476957:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864920.477020:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864920.477302:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528851840 00000100:00100000:0.0:1788864920.477314:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528851840 00000100:00100000:0.0:1788864920.477394:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 151 00000100:00100000:0.0:1788864920.477408:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca003c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+32:2359:x1875760528851840:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788864920.477492:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca003c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+32:2359:x1875760528851840:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 88us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864920.477501:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 151 00000100:00080000:3.0:1788864920.477564:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788864920.478253:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528852096 00000100:00100000:1.0:1788864920.478260:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528852096 00000100:00100000:1.0:1788864920.478310:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:1.0:1788864920.478318:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2359:x1875760528852096:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788864920.478361:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2359:x1875760528852096:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 44us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864920.478368:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00080000:2.0:1788864920.479216:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788864921.157536:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788864921.478140:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000020:00080000:1.0:1788864921.478185:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fdcc0598b40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788864921.478191:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fdcc07f5b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fdcc0598180 00000020:00080000:1.0:1788864921.478195:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fdcc07f5000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fdcc056b800 00000004:00080000:1.0:1788864921.478231:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000001:00080000:1.0:1788864921.478248:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:1.0:1788864921.478260:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:1.0:1788864921.478270:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000100:00100000:1.0:1788864921.478404:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546657664:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788864921.478594:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788864921.478682:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788864921.478981:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:3.0:1788864921.480464:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546657664 00000100:00100000:3.0:1788864921.480482:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546657664 00000100:00080000:2.0:1788864921.480516:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788864921.480562:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788864921.480576:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3301:x1875760546657664:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788864921.481583:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788864921.481591:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788864915 -> 1788864915 00002000:00010000:3.0:1788864921.481594:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1788864914 -> 1788864914 00002000:00010000:3.0:1788864921.481596:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788864915 -> 1788864915 00002000:00010000:3.0:1788864921.481599:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788864921.481756:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3301:x1875760546657664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1181us (3160us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1788864921.481774:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000004:00080000:2.0:1788864921.482482:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fdb81925880/2, rc 0, transno 4294967324 00000100:00100000:2.0:1788864921.482494:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546657664:0@lo:2:osp-syn-0-0.0 00000001:00080000:2.0:1788864921.497284:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:2.0:1788864921.497321:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:2.0:1788864921.497339:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:1.0:1788864922.183506:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864922.272167:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864922.272395:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528852352 00000100:00100000:0.0:1788864922.272478:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528852352 00000100:00100000:0.0:1788864922.272545:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 237 00000100:00080000:2.0:1788864922.272612:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788864922.273597:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+19:11320:x1875760528852352:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788864922.273791:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+19:11320:x1875760528852352:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 Request processed in 1236us (1632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864922.273799:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 237 00000100:00100000:1.0:1788864922.282353:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864922.282564:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528852608 00000100:00100000:3.0:1788864922.282575:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528852608 00000100:00100000:3.0:1788864922.282637:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:3.0:1788864922.282647:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+19:11320:x1875760528852608:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788864922.283024:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+20:11320:x1875760528852608:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 376us (680us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788864922.283032:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 65 00000040:00080000:3.0:1788864922.308940:0:11671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788864922.308951:0:11671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788864922.308993:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788864922.309000:0:11671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788864922.949814:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc063aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546657792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788864922.950171:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864922.950240:0:10234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546657792 00000100:00100000:3.0:1788864922.950576:0:10234:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546657792 00000100:00100000:3.0:1788864922.950628:0:10234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788864922.950638:0:10234:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac7b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875760546657792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788864922.951104:0:10234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788864922.951168:0:10234:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac7b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875760546657792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 531us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864922.951176:0:10234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788864922.953958:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:2.0:1788864922.953971:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fdcbc86e680, transno 4294967321 00000004:00080000:2.0:1788864922.953982:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:2.0:1788864922.954009:0:3302:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9fdb81925880 x1875760546657664/t4294967324(4294967324) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788864937 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864922.954032:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc063aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546657792:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788864923.204882:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788864923.906233:0:12695:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 06:55:22 (1788864922) 00000100:00100000:2.0:1788864923.973034:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc86e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546657920:0@lo:400:kworker.0 00000100:00100000:0.0:1788864923.973067:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546658048:0@lo:400:kworker.0 00000100:00100000:2.0:1788864923.974395:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864923.974867:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875760546658432:0@lo:400:kworker.0 00000100:00100000:2.0:1788864923.974909:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864923.974936:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788864923.974942:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546658304:0@lo:400:kworker.0 00000100:00100000:2.0:1788864923.974967:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864923.975009:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546658304 00000100:00100000:2.0:1788864923.975017:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546658304 00000100:00100000:2.0:1788864923.975071:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788864923.975081:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0638380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875760546658304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864923.975130:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0638380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875760546658304:12345-0@lo:400:kworker.0 Request processed in 50us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864923.975137:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1788864923.975156:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788864923.975191:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546658304:0@lo:400:kworker.0 00000100:00100000:1.0:1788864923.981580:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546657920 00000100:00100000:1.0:1788864923.981603:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546657920 00000100:00100000:1.0:1788864923.981685:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788864923.981697:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3303:x1875760546657920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864923.981861:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3303:x1875760546657920:12345-0@lo:400:kworker.0 Request processed in 167us (7470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864923.981882:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788864923.982055:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864923.982101:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546658560:0@lo:400:kworker.0 00000100:00100000:0.0:1788864923.982142:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864923.982174:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788864923.982181:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546658176:0@lo:400:kworker.0 00000100:00100000:0.0:1788864923.982204:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864923.982239:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546658432 00000100:00100000:0.0:1788864923.982244:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546658432 00000100:00100000:2.0:1788864923.982256:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc86e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546657920:0@lo:400:kworker.0 00000100:00100000:0.0:1788864923.982288:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546658048 00000100:00100000:0.0:1788864923.982291:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546658048 00000100:00100000:0.0:1788864923.982388:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546658176 00000100:00100000:0.0:1788864923.982392:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546658176 00000100:00100000:0.0:1788864923.982408:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788864923.982414:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc063aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875760546658432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864923.982465:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc063aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875760546658432:12345-0@lo:400:kworker.0 Request processed in 51us (7556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864923.982482:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788864923.982497:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788864923.982503:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546658048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864923.982539:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546658048:12345-0@lo:400:kworker.0 Request processed in 36us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864923.982546:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788864923.982557:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788864923.982563:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546658176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864923.982570:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875760546658432:0@lo:400:kworker.0 00000100:00100000:0.0:1788864923.982589:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546658176:12345-0@lo:400:kworker.0 Request processed in 26us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864923.982595:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788864923.982628:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546658560 00000100:00100000:0.0:1788864923.982632:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546658560 00000100:00080000:1.0:1788864923.983016:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788864923.983022:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788864923.983067:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788864923.983077:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546658560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864923.983120:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546658560:12345-0@lo:400:kworker.0 Request processed in 45us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864923.983126:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788864923.983158:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546658176:0@lo:400:kworker.0 00000100:00100000:0.0:1788864923.983171:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546658048:0@lo:400:kworker.0 00000100:00100000:0.0:1788864923.983180:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546658560:0@lo:400:kworker.0 00010000:00010000:2.0:1788864924.229146:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864924.493080:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546658688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788864924.493205:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864924.493316:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546658688 00000100:00100000:1.0:1788864924.493327:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546658688 00000100:00100000:1.0:1788864924.493389:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788864924.493398:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546658688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788864924.493462:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788864924.493513:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546658688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864924.493520:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788864924.493575:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546658688:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788864925.254929:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864925.591208:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864925.591252:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864925.591335:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864925.591358:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864925.591404:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864925.591442:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528852736 00000100:00100000:0.0:1788864925.591461:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528852736 00000100:00100000:0.0:1788864925.591514:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 296 00000100:00100000:0.0:1788864925.591531:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+13:2357:x1875760528852736:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788864925.591600:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:202cc404-00bb-4314-9125-b9b0b45f494c+13:2357:x1875760528852736:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 71us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864925.591608:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 296 00000100:00100000:3.0:1788864925.592066:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528853248 00000100:00100000:3.0:1788864925.592073:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528853248 00000100:00100000:2.0:1788864925.592099:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528852992 00000100:00100000:2.0:1788864925.592104:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528852992 00000100:00100000:3.0:1788864925.592117:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528852864 00000100:00100000:3.0:1788864925.592120:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528852864 00000100:00100000:3.0:1788864925.592139:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 155 00000100:00100000:3.0:1788864925.592146:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2357:x1875760528853248:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864925.592185:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:2357:x1875760528853248:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 39us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864925.592191:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 155 00000100:00100000:3.0:1788864925.592204:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 156 00000100:00100000:3.0:1788864925.592209:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+20:2357:x1875760528852864:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788864925.592231:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+20:2357:x1875760528852864:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 22us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864925.592236:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 156 00000100:00080000:3.0:1788864925.592260:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788864925.592263:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788864925.592453:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528853120 00000100:00100000:2.0:1788864925.592457:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528853120 00000100:00100000:0.0:1788864925.592527:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:2.0:1788864925.592532:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:0.0:1788864925.592536:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2357:x1875760528852992:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788864925.592538:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2357:x1875760528853120:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788864925.592569:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2357:x1875760528852992:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 35us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864925.592575:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00080000:3.0:1788864925.592789:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788864925.592847:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2357:x1875760528853120:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 33us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864925.592855:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:3.0:1788864926.127440:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864926.127852:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528853376 00000100:00100000:0.0:1788864926.127861:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528853376 00000100:00100000:0.0:1788864926.127917:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 238 00000100:00100000:0.0:1788864926.127927:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36a5d9c7-7504-4a4b-a03e-664186d01d07+5:12325:x1875760528853376:12345-192.168.203.13@tcp:101:lsof.0 00010000:00010000:0.0:1788864926.127946:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864926.127966:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e95a195 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fe91 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864926.128023:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e95a19c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864926.128036:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e95a19c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864926.128049:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e95a19c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864926.128081:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788864926.128098:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788864926.128140:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e95a19c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864926.128163:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4ae00/0xf8c13e2d0e95a195 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe91 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864926.128181:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e95a19c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe91 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864926.128190:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc834b8000) 00010000:00010000:0.0:1788864926.128193:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788864926.128197:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4a200, rc 0) 00000100:00100000:0.0:1788864926.128263:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36a5d9c7-7504-4a4b-a03e-664186d01d07+6:12325:x1875760528853376:12345-192.168.203.13@tcp:101:lsof.0 Request processed in 336us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864926.128272:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 238 00010000:00010000:3.0:1788864926.276950:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788864926.623915:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:1.0:1788864926.623939:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1788864926.623955:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:2.0:1788864926.623963:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000020:00080000:1.0:1788864926.623964:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788864927.300925:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864928.069412:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546658816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788864928.069486:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864928.070506:0:10234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546658816 00000100:00100000:1.0:1788864928.070517:0:10234:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546658816 00000100:00080000:3.0:1788864928.070590:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788864928.070604:0:10234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788864928.070616:0:10234:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546658816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788864928.070664:0:10234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788864928.070751:0:10234:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546658816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864928.070784:0:10234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788864928.070826:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1788864928.070833:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fdb81925880, transno 4294967324 00000100:00100000:0.0:1788864928.070856:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546658816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788864928.215095:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864928.215199:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528853632 00000100:00100000:3.0:1788864928.215209:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528853632 00000100:00100000:3.0:1788864928.215288:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:3.0:1788864928.215300:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+19:12326:x1875760528853632:12345-192.168.203.13@tcp:35:umount.0 00000100:00100000:3.0:1788864928.215637:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+20:12326:x1875760528853632:12345-192.168.203.13@tcp:35:umount.0 Request processed in 338us (549us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788864928.215660:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00080000:0.0:1788864928.218411:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864928.218803:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864928.219036:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528853888 00000100:00100000:1.0:1788864928.219046:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528853888 00000100:00100000:1.0:1788864928.219101:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:1.0:1788864928.219112:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+20:12326:x1875760528853888:12345-192.168.203.13@tcp:35:umount.0 00000100:00100000:1.0:1788864928.219458:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+21:12326:x1875760528853888:12345-192.168.203.13@tcp:35:umount.0 Request processed in 347us (658us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788864928.219466:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:2.0:1788864928.222212:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864928.222498:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528854144 00000100:00100000:1.0:1788864928.222509:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528854144 00000100:00100000:1.0:1788864928.222612:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:1.0:1788864928.222623:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca21f4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+21:12326:x1875760528854144:12345-192.168.203.13@tcp:35:umount.0 00000100:00100000:1.0:1788864928.222912:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca21f4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+22:12326:x1875760528854144:12345-192.168.203.13@tcp:35:umount.0 Request processed in 290us (707us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788864928.222920:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:2.0:1788864928.233118:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864928.237759:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528854400 00000100:00100000:0.0:1788864928.237784:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528854400 00000100:00100000:0.0:1788864928.237854:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:0.0:1788864928.237865:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+22:12326:x1875760528854400:12345-192.168.203.13@tcp:35:umount.0 00000100:00100000:0.0:1788864928.238209:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1cf2dd0f-7f2d-465e-9303-244222bc89bf+23:12326:x1875760528854400:12345-192.168.203.13@tcp:35:umount.0 Request processed in 345us (5100us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788864928.238217:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:3.0:1788864928.248810:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864928.248862:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864928.248883:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864928.248915:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864928.249080:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528854528 00000100:00100000:0.0:1788864928.249090:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528854528 00000100:00100000:0.0:1788864928.249134:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528854656 00000100:00100000:0.0:1788864928.249137:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528854656 00000100:00100000:0.0:1788864928.249148:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528854784 00000100:00100000:0.0:1788864928.249150:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528854784 00000100:00100000:0.0:1788864928.249165:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:0.0:1788864928.249175:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:202cc404-00bb-4314-9125-b9b0b45f494c+15:2358:x1875760528854528:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788864928.249190:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864928.249208:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdca4d14c00/0xf8c13e2d0e959222 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa23 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864928.249225:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864928.249295:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:202cc404-00bb-4314-9125-b9b0b45f494c+14:2358:x1875760528854528:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 121us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864928.249302:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:0.0:1788864928.249319:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:0.0:1788864928.249326:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1e52450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:202cc404-00bb-4314-9125-b9b0b45f494c+13:2358:x1875760528854656:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788864928.249334:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864928.249343:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdb8213e200/0xf8c13e2d0e959188 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975f9eb expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864928.249353:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864928.249370:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1e52450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:202cc404-00bb-4314-9125-b9b0b45f494c+12:2358:x1875760528854656:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 45us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864928.249389:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:0.0:1788864928.249427:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:0.0:1788864928.249433:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:202cc404-00bb-4314-9125-b9b0b45f494c+11:2359:x1875760528854784:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788864928.249441:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864928.249450:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcb5384400/0xf8c13e2d0e959436 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975faee expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864928.249458:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864928.249475:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:202cc404-00bb-4314-9125-b9b0b45f494c+10:2359:x1875760528854784:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 41us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864928.249481:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:0.0:1788864928.249501:0:8199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528854912 00000100:00100000:0.0:1788864928.249505:0:8199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528854912 00000100:00100000:0.0:1788864928.249539:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:0.0:1788864928.249545:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2355:x1875760528854912:12345-192.168.203.13@tcp:9:umount.0 00000020:00000080:0.0:1788864928.249567:0:8199:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e9594fa 00000100:00080000:0.0:1788864928.249574:0:8199:0:(import.c:65:import_set_state_nolock()) ffff9fdc82ac3000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788864928.249606:0:8199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788864928.249895:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+2:2355:x1875760528854912:12345-192.168.203.13@tcp:9:umount.0 Request processed in 349us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864928.249902:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00080000:0.0:1788864928.249922:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788864928.250595:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864928.254378:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864928.255353:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528855296 00000100:00100000:0.0:1788864928.255364:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528855296 00000100:00100000:0.0:1788864928.255476:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:0.0:1788864928.255487:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+7:2355:x1875760528855296:12345-192.168.203.13@tcp:9:umount.0 00000020:00000080:0.0:1788864928.255534:0:6684:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e95975b 00000020:00010000:0.0:1788864928.255541:0:6684:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9fdcbc867000: total 0 00000100:00080000:0.0:1788864928.255546:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9fdcbc866000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788864928.255590:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788864928.255905:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1cf2dd0f-7f2d-465e-9303-244222bc89bf+5:2355:x1875760528855296:12345-192.168.203.13@tcp:9:umount.0 Request processed in 419us (1536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864928.255913:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 73 00000020:00010000:3.0:1788864928.256177:0:5824:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9fdcbc867000: total 0 00010000:00010000:3.0:1788864928.256209:0:5824:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fdcbc867000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788864928.256261:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d6e5b84/0xf8c13e2d0e959afe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcc3 expref: 4 pid: 8199 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864928.256305:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022890424/0xf8c13e2d0e95a18e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe8a expref: 3 pid: 8199 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864928.256319:0:5824:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fdcbc867000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788864928.256331:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864928.256333:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864928.256335:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788864928.261817:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788864928.266572:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788864928.266654:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528856320 00000100:00100000:1.0:1788864928.266663:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528856320 00000100:00100000:1.0:1788864928.266753:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 239 00000100:00100000:1.0:1788864928.266774:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+23:2355:x1875760528856320:12345-192.168.203.13@tcp:39:umount.0 00000020:00000080:1.0:1788864928.266810:0:6705:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e959196 00000020:00010000:1.0:1788864928.267046:0:6705:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9fdb81807800: total 0 00000100:00080000:1.0:1788864928.267053:0:6705:0:(import.c:65:import_set_state_nolock()) ffff9fdc9081d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788864928.267082:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:1.0:1788864928.267497:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1cf2dd0f-7f2d-465e-9303-244222bc89bf+22:2355:x1875760528856320:12345-192.168.203.13@tcp:39:umount.0 Request processed in 733us (932us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788864928.267520:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 239 00000020:00010000:2.0:1788864928.267606:0:5823:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9fdb81807800: total 0 00010000:00010000:2.0:1788864928.267646:0:5823:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fdb81807800, canceled 0 locks, left on hash table 14. 00010000:00010000:2.0:1788864928.267677:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:2.0:1788864928.267681:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788864928.267689:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e95a179 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe83 expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864928.267739:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:2.0:1788864928.267742:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788864928.267746:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e9599df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fc76 expref: 20 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864928.267759:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:2.0:1788864928.267770:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788864928.267774:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e959adb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcb5 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864928.267787:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:2.0:1788864928.267789:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788864928.267800:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e959e4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fdb1 expref: 18 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864928.267814:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:2.0:1788864928.267817:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788864928.267820:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e9594d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb18 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864928.267847:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:2.0:1788864928.267849:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788864928.267853:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385800/0xf8c13e2d0e95a06f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe3d expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864928.267865:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fdc8328e800) 00010000:00010000:2.0:1788864928.267867:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788864928.267870:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e959b6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcdf expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864928.267886:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fdca4f57c00) 00010000:00010000:2.0:1788864928.267888:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864928.267892:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4bc00/0xf8c13e2d0e95947c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fb03 expref: 14 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864928.267906:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:2.0:1788864928.267908:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788864928.267911:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e959ae9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcbc expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864928.267923:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fdc8328e600) 00010000:00010000:2.0:1788864928.267931:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788864928.267936:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384200/0xf8c13e2d0e959ab1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcae expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864928.267953:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fdc8328e500) 00010000:00010000:2.0:1788864928.267956:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788864928.267960:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74400/0xf8c13e2d0e9597bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fbea expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864928.267973:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fdc8328e400) 00010000:00010000:2.0:1788864928.267975:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788864928.267978:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74e00/0xf8c13e2d0e959460 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fafc expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864928.267991:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fdc8328e200) 00010000:00010000:2.0:1788864928.267993:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788864928.267997:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a14f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe75 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864928.268011:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc834b8000) 00010000:00010000:2.0:1788864928.268013:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788864928.268017:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e959b52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fcd8 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864928.268027:0:5823:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fdb81807800, canceled 14 locks, left on hash table 0. 00010000:00010000:2.0:1788864928.268040:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864928.268042:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864928.268043:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864928.325094:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864929.093989:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcafca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546659072:0@lo:400:kworker.0 00000100:00100000:1.0:1788864929.094061:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864929.094134:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788864929.094141:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcafca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546659200:0@lo:400:kworker.0 00000100:00100000:1.0:1788864929.094164:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864929.094211:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546659072 00000100:00100000:1.0:1788864929.094219:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546659072 00000100:00100000:1.0:1788864929.094263:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546659200 00000100:00100000:1.0:1788864929.094266:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546659200 00000100:00100000:1.0:1788864929.094295:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788864929.094303:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546659072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864929.094355:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546659072:12345-0@lo:400:kworker.0 Request processed in 52us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864929.094362:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788864929.094377:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788864929.094384:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546659200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864929.094410:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546659200:12345-0@lo:400:kworker.0 Request processed in 27us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864929.094416:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788864929.094449:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcafca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546659200:0@lo:400:kworker.0 00000100:00100000:1.0:1788864929.094459:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcafca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546659072:0@lo:400:kworker.0 00000100:00100000:2.0:1788864929.094550:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcafca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546658944:0@lo:400:kworker.0 00000100:00100000:2.0:1788864929.094599:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788864929.094643:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788864929.096392:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546658944 00000100:00100000:1.0:1788864929.096406:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546658944 00000100:00100000:1.0:1788864929.096545:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788864929.096555:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3303:x1875760546658944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864929.096655:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3303:x1875760546658944:12345-0@lo:400:kworker.0 Request processed in 102us (2055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864929.096663:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788864929.096836:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788864929.096851:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc7e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546659584:0@lo:400:kworker.0 00000100:00100000:3.0:1788864929.096892:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864929.096950:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcafca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875760546659456:0@lo:400:kworker.0 00000100:00100000:3.0:1788864929.096995:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864929.097027:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcafca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546658944:0@lo:400:kworker.0 00000100:00100000:3.0:1788864929.097045:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788864929.097060:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcafca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546659328:0@lo:400:kworker.0 00000100:00100000:3.0:1788864929.097083:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864929.097108:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546659456 00000100:00100000:3.0:1788864929.097113:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546659456 00000100:00100000:3.0:1788864929.097153:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00080000:2.0:1788864929.097410:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864929.097474:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875760546659456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864929.097525:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875760546659456:12345-0@lo:400:kworker.0 Request processed in 54us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864929.097531:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788864929.097577:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcafca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875760546659456:0@lo:400:kworker.0 00000100:00100000:0.0:1788864929.097959:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546659584 00000100:00100000:0.0:1788864929.097966:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546659584 00000100:00100000:0.0:1788864929.098016:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546659328 00000100:00100000:0.0:1788864929.098020:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546659328 00000100:00080000:1.0:1788864929.098042:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788864929.098049:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788864929.098059:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546659584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864929.098090:0:8199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788864929.098102:0:8199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546659328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864929.098119:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546659584:12345-0@lo:400:kworker.0 Request processed in 61us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864929.098127:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788864929.098151:0:8199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546659328:12345-0@lo:400:kworker.0 Request processed in 51us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864929.098157:0:8199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788864929.098184:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc7e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546659584:0@lo:400:kworker.0 00000100:00100000:1.0:1788864929.098193:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcafca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546659328:0@lo:400:kworker.0 00010000:00010000:3.0:1788864929.348993:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864929.607736:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788864929.607776:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546659712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788864929.607843:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864929.608190:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546659712 00000100:00100000:1.0:1788864929.608198:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546659712 00000100:00100000:1.0:1788864929.608247:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788864929.608256:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546659712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788864929.608291:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788864929.608344:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546659712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864929.608358:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788864929.608764:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546659712:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788864930.372908:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864930.568080:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788864930.568137:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864930.568971:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528856448 00000100:00100000:0.0:1788864930.568981:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528856448 00000100:00100000:0.0:1788864930.569042:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528856576 00000100:00100000:0.0:1788864930.569046:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528856576 00000100:00100000:0.0:1788864930.569065:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:0.0:1788864930.569074:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:202cc404-00bb-4314-9125-b9b0b45f494c+11:2359:x1875760528856448:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788864930.569088:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864930.569107:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcc2045000/0xf8c13e2d0e959268 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa38 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864930.569141:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864930.569199:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:202cc404-00bb-4314-9125-b9b0b45f494c+10:2359:x1875760528856448:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 125us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864930.569206:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:0.0:1788864930.569223:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:0.0:1788864930.569229:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:202cc404-00bb-4314-9125-b9b0b45f494c+9:2359:x1875760528856576:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788864930.569236:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864930.569246:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcc2044400/0xf8c13e2d0e95926f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa62 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864930.569264:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864930.569284:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:202cc404-00bb-4314-9125-b9b0b45f494c+8:2359:x1875760528856576:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 55us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864930.569291:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:3.0:1788864930.572164:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864930.572237:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528856704 00000100:00100000:0.0:1788864930.572254:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528856704 00000100:00100000:0.0:1788864930.572311:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:0.0:1788864930.572322:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:202cc404-00bb-4314-9125-b9b0b45f494c+8:2359:x1875760528856704:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788864930.572339:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864930.572358:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdc81497600/0xf8c13e2d0e95942f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fae7 expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864930.572375:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864930.572428:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:202cc404-00bb-4314-9125-b9b0b45f494c+7:2359:x1875760528856704:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 107us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864930.572451:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:3.0:1788864930.583508:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788864930.584102:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528856960 00000100:00100000:2.0:1788864930.584123:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528856960 00000100:00100000:2.0:1788864930.584199:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 240 00000100:00100000:2.0:1788864930.584210:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36a5d9c7-7504-4a4b-a03e-664186d01d07+6:2355:x1875760528856960:12345-192.168.203.13@tcp:39:umount.0 00000100:00080000:1.0:1788864930.584223:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1788864930.584252:0:5835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e95927d 00000020:00010000:2.0:1788864930.584261:0:5835:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9fdcc0032800: total 0 00000100:00080000:2.0:1788864930.584267:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9fdcc0034800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788864930.584295:0:5835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:1.0:1788864930.584326:0:11155:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9fdcc0032800: total 0 00010000:00010000:1.0:1788864930.584331:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864930.584376:0:11155:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fdcc0032800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788864930.584424:0:11155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc834b8000) 00010000:00010000:1.0:1788864930.584441:0:11155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788864930.584454:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdca2d4a200/0xf8c13e2d0e95a19c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fe91 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864930.584480:0:11155:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fdcc0032800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788864930.584493:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864930.584495:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864930.584497:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864930.584531:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36a5d9c7-7504-4a4b-a03e-664186d01d07+3:2355:x1875760528856960:12345-192.168.203.13@tcp:39:umount.0 Request processed in 322us (1030us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788864930.584540:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 240 00000100:00100000:3.0:1788864930.604882:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788864930.605011:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528857216 00000100:00100000:0.0:1788864930.605021:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528857216 00000100:00100000:0.0:1788864930.605075:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 298 00000100:00100000:0.0:1788864930.605084:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+7:2355:x1875760528857216:12345-192.168.203.13@tcp:251:umount.0 00000020:00000080:0.0:1788864930.605136:0:5830:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e959173 00000020:00010000:0.0:1788864930.605143:0:5830:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9fdc9081c800: total 0 00000100:00080000:0.0:1788864930.605147:0:5830:0:(import.c:65:import_set_state_nolock()) ffff9fdc90819000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788864930.605220:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1f12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:202cc404-00bb-4314-9125-b9b0b45f494c+3:2355:x1875760528857216:12345-192.168.203.13@tcp:251:umount.0 Request processed in 136us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864930.605228:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 298 00000020:00010000:3.0:1788864930.605569:0:5824:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9fdc9081c800: total 0 00010000:00010000:3.0:1788864930.605612:0:5824:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fdc9081c800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788864930.605644:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdb8213ee00/0xf8c13e2d0e959229 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fa2a expref: 2 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864930.605659:0:5824:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fdc9081c800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788864930.605671:0:5824:0:(genops.c:885:class_export_put()) final put ffff9fdc9081c800/202cc404-00bb-4314-9125-b9b0b45f494c 00010000:00010000:3.0:1788864930.605689:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864930.605743:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864930.605756:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788864930.605905:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdc9081c800/202cc404-00bb-4314-9125-b9b0b45f494c for MGS 00000020:00000080:0.0:1788864930.605948:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fdc90819000 for MGS 00010000:00010000:0.0:1788864931.398540:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788864931.729813:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:2.0:1788864931.729834:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1cf2dd0f-7f2d-465e-9303-244222bc89bf 00000001:00080000:2.0:1788864931.729840:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:2.0:1788864931.729851:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 36a5d9c7-7504-4a4b-a03e-664186d01d07 00000001:00080000:2.0:1788864931.729856:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1788864931.729859:0:5858:0:(genops.c:885:class_export_put()) final put ffff9fdcc0032800/36a5d9c7-7504-4a4b-a03e-664186d01d07 00000020:00000080:2.0:1788864931.729875:0:5858:0:(genops.c:885:class_export_put()) final put ffff9fdb81807800/1cf2dd0f-7f2d-465e-9303-244222bc89bf 00000020:00000080:2.0:1788864931.729887:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcc0032800/36a5d9c7-7504-4a4b-a03e-664186d01d07 for lustre-MDT0000 00000020:00000080:2.0:1788864931.729933:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdb81807800/1cf2dd0f-7f2d-465e-9303-244222bc89bf for lustre-MDT0000 00000020:00000080:2.0:1788864931.729969:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fdcc0034800 for lustre-MDT0000 00000020:00000080:2.0:1788864931.729974:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fdc9081d800 for lustre-MDT0000 00000001:00100000:1.0:1788864931.740285:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1cf2dd0f-7f2d-465e-9303-244222bc89bf 00000020:00000080:1.0:1788864931.740294:0:6709:0:(genops.c:885:class_export_put()) final put ffff9fdcbc867000/1cf2dd0f-7f2d-465e-9303-244222bc89bf 00000020:00000080:1.0:1788864931.740320:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcbc867000/1cf2dd0f-7f2d-465e-9303-244222bc89bf for lustre-OST0000 00000020:00000080:1.0:1788864931.740363:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fdcbc866000 for lustre-OST0000 00000020:01000004:0.0:1788864932.025855:0:12896:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788864932.047872:0:12896:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788864932.047920:0:12896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f200/0xf8c13e2d0e9591f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9591ff expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864932.047935:0:12896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f200/0xf8c13e2d0e9591f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e9591ff expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864932.047944:0:12896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f200/0xf8c13e2d0e9591f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf8c13e2d0e9591ff expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864932.047952:0:12896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f200/0xf8c13e2d0e9591f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf8c13e2d0e9591ff expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864932.047988:0:12896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788864932.047993:0:12896:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788864932.048014:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788864932.048018:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788864932.048024:0:12896:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788864932.048046:0:12896:0:(import.c:65:import_set_state_nolock()) ffff9fdc83527000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788864932.048985:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788864932.048994:0:11155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f200/0xf8c13e2d0e9591f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf8c13e2d0e9591ff expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864932.049003:0:11155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213f200 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:1.0:1788864932.049007:0:11155:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f200/0xf8c13e2d0e9591f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf8c13e2d0e9591ff expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864932.049016:0:11155:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f200/0xf8c13e2d0e9591f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf8c13e2d0e9591ff expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788864932.049024:0:11155:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f200/0xf8c13e2d0e9591f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf8c13e2d0e9591ff expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788864932.049029:0:11155:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788864932.049032:0:11155:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788864932.049034:0:11155:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788864932.049060:0:11155:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f200/0xf8c13e2d0e9591f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf8c13e2d0e9591ff expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864932.049074:0:11155:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788864932.049093:0:11155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f200/0xf8c13e2d0e9591f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf8c13e2d0e9591ff expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864932.049100:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f200/0xf8c13e2d0e9591f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf8c13e2d0e9591ff expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864932.049112:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864932.049114:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864932.049116:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864932.049131:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0554a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546659968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788864932.049192:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864932.049254:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546659968 00000100:00100000:1.0:1788864932.049260:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546659968 00000100:00100000:1.0:1788864932.049302:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788864932.049309:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81926680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3302:x1875760546659968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788864932.049320:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864932.049332:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcc2045a00/0xf8c13e2d0e9591ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf8c13e2d0e9591f8 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864932.049344:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864932.049370:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81926680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:3302:x1875760546659968:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864932.049377:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788864932.049413:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0554a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546659968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788864932.049514:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875760546659840:0@lo:39:umount.0 00000100:00100000:2.0:1788864932.049553:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864932.053755:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546659840 00000100:00100000:1.0:1788864932.053778:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546659840 00000100:00100000:1.0:1788864932.053855:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788864932.053865:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875760546659840:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788864932.053895:0:5837:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e958f82 00000100:00080000:1.0:1788864932.053904:0:5837:0:(import.c:65:import_set_state_nolock()) ffff9fdcb105b800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788864932.054002:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3299:x1875760546659840:12345-0@lo:39:umount.0 Request processed in 138us (4447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864932.054008:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:1.0:1788864932.054018:0:5837:0:(genops.c:885:class_export_put()) final put ffff9fdcb105e000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788864932.054043:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcb105e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788864932.054084:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fdcb105b800 for lustre-MDT0000 00010000:00010000:3.0:1788864932.054149:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788864932.054549:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fdc83527000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788864932.054568:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875760546659840:0@lo:39:umount.0 00000100:00080000:0.0:1788864932.054601:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788864932.054605:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788864932.054609:0:12896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788864932.055995:0:12896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e000/0xf8c13e2d0e959206 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95920d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864932.056011:0:12896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e000/0xf8c13e2d0e959206 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95920d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864932.056019:0:12896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e000/0xf8c13e2d0e959206 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf8c13e2d0e95920d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864932.056026:0:12896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e000/0xf8c13e2d0e959206 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf8c13e2d0e95920d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864932.056085:0:12896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788864932.056092:0:12896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044200/0xf8c13e2d0e95912d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959134 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864932.056098:0:12896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044200/0xf8c13e2d0e95912d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e959134 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864932.056121:0:12896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044200/0xf8c13e2d0e95912d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf8c13e2d0e959134 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864932.056127:0:12896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044200/0xf8c13e2d0e95912d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf8c13e2d0e959134 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.056155:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788864932.056162:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e000/0xf8c13e2d0e959206 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf8c13e2d0e95920d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.056169:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213e000 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1788864932.056173:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e000/0xf8c13e2d0e959206 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf8c13e2d0e95920d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.056182:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e000/0xf8c13e2d0e959206 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf8c13e2d0e95920d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788864932.056189:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e000/0xf8c13e2d0e959206 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf8c13e2d0e95920d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864932.056194:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788864932.056197:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788864932.056226:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e000/0xf8c13e2d0e959206 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf8c13e2d0e95920d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.056233:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788864932.056346:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc86e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546660096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788864932.056408:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788864932.056475:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e000/0xf8c13e2d0e959206 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf8c13e2d0e95920d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.056482:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdb8213e000/0xf8c13e2d0e959206 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf8c13e2d0e95920d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.056497:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864932.056506:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044200/0xf8c13e2d0e95912d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf8c13e2d0e959134 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.056513:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc2044200 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1788864932.056516:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044200/0xf8c13e2d0e95912d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf8c13e2d0e959134 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.056523:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044200/0xf8c13e2d0e95912d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf8c13e2d0e959134 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788864932.056530:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044200/0xf8c13e2d0e95912d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf8c13e2d0e959134 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864932.056535:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788864932.056537:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1788864932.056550:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044200/0xf8c13e2d0e95912d lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf8c13e2d0e959134 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.056555:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788864932.056570:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044200/0xf8c13e2d0e95912d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf8c13e2d0e959134 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.056577:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864932.056578:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864932.056580:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864932.056588:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788864932.056597:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546660224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788864932.056625:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864932.056746:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546660096 00000100:00100000:3.0:1788864932.056753:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546660096 00000100:00100000:3.0:1788864932.056792:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546660224 00000100:00100000:3.0:1788864932.056795:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546660224 00000100:00100000:3.0:1788864932.056809:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788864932.056818:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81924380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+19:3303:x1875760546660096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788864932.056828:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864932.056841:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdc80030800/0xf8c13e2d0e95920d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf8c13e2d0e959206 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864932.056854:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788864932.057078:0:12896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788864932.057084:0:12896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044200/0xf8c13e2d0e95912d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf8c13e2d0e959134 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864932.057102:0:12896:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788864932.057110:0:12896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdc81497c00/0xf8c13e2d0e959421 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e959428 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864932.057117:0:12896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdc81497c00/0xf8c13e2d0e959421 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e959428 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864932.057124:0:12896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdc81497c00/0xf8c13e2d0e959421 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf8c13e2d0e959428 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864932.057130:0:12896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9fdc81497c00/0xf8c13e2d0e959421 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf8c13e2d0e959428 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864932.057143:0:12896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788864932.057149:0:12896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15800/0xf8c13e2d0e958ee1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e958ee8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864932.057155:0:12896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15800/0xf8c13e2d0e958ee1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e958ee8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864932.057168:0:12896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15800/0xf8c13e2d0e958ee1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf8c13e2d0e958ee8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864932.057174:0:12896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15800/0xf8c13e2d0e958ee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf8c13e2d0e958ee8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864932.057184:0:12896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788864932.057188:0:12896:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788864932.057190:0:12896:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788864932.057214:0:12896:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788864932.057218:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788864932.057222:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788864932.057227:0:12896:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788864932.057232:0:12896:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9fdb824aa000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788864932.057238:0:12896:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9fdb81807000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788864932.057253:0:12896:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9fdcc0804d40) has exports, disconnecting them 00000020:00080000:0.0:1788864932.057258:0:12896:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fdb824aa000), last request at 1788864929 00000020:00000080:0.0:1788864932.057263:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e9590f5 00000100:00080000:0.0:1788864932.057279:0:12896:0:(import.c:65:import_set_state_nolock()) ffff9fdb824a9800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788864932.057317:0:12896:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fdb824aa000): rc 0 00000020:00000080:0.0:1788864932.057320:0:12896:0:(genops.c:885:class_export_put()) final put ffff9fdb824aa000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788864932.057329:0:12896:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fdb81807000), last request at 1788864929 00000020:00000080:0.0:1788864932.057332:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e95901c 00000100:00080000:0.0:1788864932.057338:0:12896:0:(import.c:65:import_set_state_nolock()) ffff9fdb81806000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788864932.057344:0:12896:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fdb81807000): rc 0 00000020:00000080:0.0:1788864932.057346:0:12896:0:(genops.c:885:class_export_put()) final put ffff9fdb81807000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1788864932.057357:0:12896:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbd8c81ca7ae0 00000100:00080000:0.0:1788864932.057382:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788864932.057385:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1788864932.057396:0:12896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788864932.057458:0:12896:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788864932.057471:0:12896:0:(import.c:65:import_set_state_nolock()) ffff9fdca2cf9800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788864932.057482:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788864932.057484:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1788864932.057490:0:12896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788864932.057548:0:12896:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788864932.057557:0:12896:0:(import.c:65:import_set_state_nolock()) ffff9fdcbffeb000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788864932.057584:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9fdcc0804d40) has no exports 00000100:00100000:2.0:1788864932.058149:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875760546660352:0@lo:9:umount.0 00000100:00100000:2.0:1788864932.058193:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864932.058228:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875760546660480:0@lo:9:umount.0 00000100:00100000:2.0:1788864932.058316:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864932.058349:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546660352 00000100:00100000:2.0:1788864932.058354:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546660352 00000100:00100000:2.0:1788864932.058393:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546660480 00000100:00100000:2.0:1788864932.058396:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546660480 00000100:00100000:2.0:1788864932.058417:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788864932.058425:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875760546660352:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788864932.058445:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e959069 00000100:00080000:2.0:1788864932.058452:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9fdb81198000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788864932.058475:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788864932.058751:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788864932.058760:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875760546660480:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788864932.058774:0:6685:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e95915e 00000100:00080000:0.0:1788864932.058780:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9fdc90818800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788864932.058799:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788864932.058924:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3299:x1875760546660480:12345-0@lo:9:umount.0 Request processed in 165us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864932.058931:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788864932.059121:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3299:x1875760546660352:12345-0@lo:9:umount.0 Request processed in 697us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864932.059128:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:2.0:1788864932.059146:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788864932.059153:0:11155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdc81497c00/0xf8c13e2d0e959421 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf8c13e2d0e959428 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.059162:0:11155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdc81497c00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1788864932.059166:0:11155:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdc81497c00/0xf8c13e2d0e959421 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf8c13e2d0e959428 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.059174:0:11155:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdc81497c00/0xf8c13e2d0e959421 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf8c13e2d0e959428 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788864932.059181:0:11155:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdc81497c00/0xf8c13e2d0e959421 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf8c13e2d0e959428 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864932.059186:0:11155:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788864932.059189:0:11155:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788864932.059199:0:11155:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788864932.059222:0:11155:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdc81497c00/0xf8c13e2d0e959421 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf8c13e2d0e959428 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.059229:0:11155:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788864932.059521:0:11155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdc81497c00/0xf8c13e2d0e959421 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf8c13e2d0e959428 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.059530:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdc81497c00/0xf8c13e2d0e959421 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf8c13e2d0e959428 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.059543:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864932.059547:0:11155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15800/0xf8c13e2d0e958ee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf8c13e2d0e958ee8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.059552:0:11155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca4d15800 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1788864932.059555:0:11155:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15800/0xf8c13e2d0e958ee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf8c13e2d0e958ee8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.059561:0:11155:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15800/0xf8c13e2d0e958ee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf8c13e2d0e958ee8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788864932.059567:0:11155:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15800/0xf8c13e2d0e958ee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf8c13e2d0e958ee8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864932.059572:0:11155:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788864932.059574:0:11155:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788864932.059576:0:11155:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788864932.059592:0:11155:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15800/0xf8c13e2d0e958ee1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf8c13e2d0e958ee8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.059598:0:11155:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788864932.059613:0:11155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15800/0xf8c13e2d0e958ee1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf8c13e2d0e958ee8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.059620:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15800/0xf8c13e2d0e958ee1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf8c13e2d0e958ee8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.059643:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864932.059645:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864932.059647:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788864932.059673:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fdca2cf9800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788864932.059685:0:3299:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788864932.059688:0:3299:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788864932.059692:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875760546660352:0@lo:9:umount.0 00000100:00080000:2.0:1788864932.059725:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fdcbffeb000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788864932.059734:0:3299:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788864932.059743:0:3299:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788864932.059746:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875760546660480:0@lo:9:umount.0 00010000:00010000:2.0:1788864932.059776:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864932.059881:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546660608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788864932.059919:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864932.060001:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81924380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:3303:x1875760546660096:12345-0@lo:103:ldlm_bl.0 Request processed in 3182us (3591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864932.060010:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788864932.060028:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546660608 00000100:00100000:3.0:1788864932.060032:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546660608 00000100:00100000:3.0:1788864932.060055:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788864932.060062:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca5b77050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+18:3301:x1875760546660224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788864932.060072:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864932.060084:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdb8213e800/0xf8c13e2d0e959134 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf8c13e2d0e95912d expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864932.060097:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788864932.060165:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca5b77050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+17:3301:x1875760546660224:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (3539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864932.060171:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788864932.060227:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788864932.060233:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+16:3301:x1875760546660608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788864932.060250:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864932.060259:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdc81496600/0xf8c13e2d0e959428 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf8c13e2d0e959421 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864932.060269:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788864932.060291:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:3301:x1875760546660608:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864932.060296:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788864932.060321:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864932.060426:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc86e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546660096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788864932.060441:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788864932.060446:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546660736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788864932.060470:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1788864932.060504:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdb824aa000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:3.0:1788864932.060566:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546660736 00000100:00100000:3.0:1788864932.060570:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546660736 00000100:00100000:3.0:1788864932.060592:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788864932.060597:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81925180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+15:3303:x1875760546660736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788864932.060604:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864932.060612:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdc80031a00/0xf8c13e2d0e958ee8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf8c13e2d0e958ee1 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864932.060624:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788864932.060660:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81925180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96+14:3303:x1875760546660736:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864932.060665:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788864932.060954:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546660224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788864932.060969:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3301:1875760546660608:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1788864932.061485:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdb81807000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788864932.061529:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fdb824a9800 for lustre-MDT0000 00000020:00000080:1.0:1788864932.061535:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fdb81806000 for lustre-MDT0000 00000100:00080000:1.0:1788864932.061663:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788864932.061668:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788864932.061854:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3303:1875760546660736:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788864932.072075:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9fdcc0804d40) has no exports 00000020:00000080:0.0:1788864932.138403:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e958f3c 00000020:00000080:0.0:1788864932.138418:0:12896:0:(genops.c:885:class_export_put()) final put ffff9fdcbc70b000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788864932.138440:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788864932.138511:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcbc70b000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788864932.138539:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788864932.138550:0:12896:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788864932.138554:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9fdca5be3380) has no exports 00000020:00000080:0.0:1788864932.138881:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e958f35 00000020:00000080:0.0:1788864932.138888:0:12896:0:(genops.c:885:class_export_put()) final put ffff9fdcc14da000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788864932.138937:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788864932.138945:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788864932.138947:0:12896:0:(genops.c:885:class_export_put()) final put ffff9fdcc14dd800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788864932.138950:0:12896:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcc14dd800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788864932.138957:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788864932.139000:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcc14da000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788864932.139077:0:12896:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fdca2cb8780 - data ffff9fdc8f3a5360/ffff9fdcbfe6b400 00000020:01000000:0.0:1788864932.139229:0:12896:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fdca0e32f00 - data ffff9fdc8f03aa20/ffff9fdcbba21800 00000001:00000004:2.0:1788864932.163162:0:12896:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788864932.229323:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788864932.229334:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788864932.229358:0:12896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788864932.229361:0:12896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788864932.229851:0:6888:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788864932.229856:0:6888:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1788864932.229865:0:6888:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788864932.231505:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788864932.231567:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788864932.231642:0:12896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788864932.231645:0:12896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788864932.232131:0:8096:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788864932.232142:0:8096:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1788864932.232150:0:8096:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788864932.315214:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e958f04 00000020:00000080:0.0:1788864932.315226:0:12896:0:(genops.c:885:class_export_put()) final put ffff9fdcacbf7000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788864932.315290:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcacbf7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788864932.318458:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e958f19 00000020:00000080:0.0:1788864932.318471:0:12896:0:(genops.c:885:class_export_put()) final put ffff9fdcc0810000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788864932.318489:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788864932.318495:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788864932.318503:0:12896:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788864932.318507:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9fdcc0800000) has no exports 00000020:00000080:2.0:1788864932.318580:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcc0810000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1788864932.320193:0:12896:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788864932.320208:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e959157 00000020:00000080:0.0:1788864932.320216:0:12896:0:(genops.c:885:class_export_put()) final put ffff9fdcbffe8800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788864932.320231:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788864932.320240:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788864932.320249:0:12896:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788864932.320253:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9fdc909999c0) has no exports 00000020:00000080:0.0:1788864932.320260:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e959150 00000020:00000080:0.0:1788864932.320264:0:12896:0:(genops.c:885:class_export_put()) final put ffff9fdcbffe9800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788864932.320596:0:12896:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788864932.320601:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788864932.320605:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1788864932.320610:0:12896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788864932.320612:0:12896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788864932.320891:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcbffe8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788864932.320900:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcbffe9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788864932.320905:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fdcbffeb000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788864932.322491:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788864932.322514:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788864932.322519:0:12896:0:(genops.c:885:class_export_put()) final put ffff9fdb824ae000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788864932.322523:0:12896:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdb824ae000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788864932.322530:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788864932.322595:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e959062 00000020:00000080:0.0:1788864932.322601:0:12896:0:(genops.c:885:class_export_put()) final put ffff9fdcbffed000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788864932.322618:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788864932.322622:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788864932.322634:0:12896:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788864932.322639:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9fdc9099cd40) has no exports 00000020:00000080:0.0:1788864932.322646:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e95905b 00000020:00000080:0.0:1788864932.322649:0:12896:0:(genops.c:885:class_export_put()) final put ffff9fdca2cfa000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788864932.322683:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcbffed000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788864932.322691:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdca2cfa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788864932.323822:0:12896:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788864932.323828:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788864932.323832:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1788864932.323838:0:12896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788864932.323840:0:12896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788864932.323887:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788864932.323895:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788864932.323928:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788864932.323930:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788864932.323935:0:12896:0:(genops.c:885:class_export_put()) final put ffff9fdcacbf6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788864932.323939:0:12896:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcacbf6800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788864932.323945:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788864932.324010:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fdca2cf9800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788864932.324017:0:8:0:(genops.c:885:class_export_put()) final put ffff9fdb81803800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788864932.324018:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdb81803800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788864932.324023:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788864932.324091:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e958f20 00000020:00000080:0.0:1788864932.324096:0:12896:0:(genops.c:885:class_export_put()) final put ffff9fdcc0815000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788864932.324115:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788864932.324118:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788864932.324123:0:12896:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788864932.324126:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9fdcc0803380) has no exports 00000020:00000080:2.0:1788864932.324135:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcc0815000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788864932.324143:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788864932.324154:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788864932.324156:0:12896:0:(genops.c:885:class_export_put()) final put ffff9fdcacbf2000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788864932.324159:0:12896:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcacbf2000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788864932.324162:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788864932.324298:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e958f27 00000020:00000080:0.0:1788864932.324302:0:12896:0:(genops.c:885:class_export_put()) final put ffff9fdcc0815800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788864932.324318:0:12896:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fdc8878e000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788864932.324321:0:12896:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fdc8878e000 3 00000020:01000004:0.0:1788864932.324324:0:12896:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fdc8878e000 from lustre-MDT0000 00000020:00000080:0.0:1788864932.324345:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788864932.324349:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788864932.324352:0:12896:0:(genops.c:885:class_export_put()) final put ffff9fdcacbf3000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788864932.324354:0:12896:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcacbf3000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788864932.324360:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:2.0:1788864932.324377:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcc0815800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1788864932.324383:0:12896:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788864932.324386:0:12896:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788864932.324389:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788864932.324391:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788864932.324394:0:12896:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788864932.324401:0:12896:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9fdca0050000 ad9c839d-b0de-4595-ae42-0c3c3a7e2f96 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788864932.324405:0:12896:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9fdca5be4d40) has exports, disconnecting them 00000020:00080000:0.0:1788864932.324409:0:12896:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9fdca0050000), last request at 1788864725 00000020:00000080:0.0:1788864932.324422:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e958ec5 00000020:00010000:0.0:1788864932.324426:0:12896:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9fdca0050000: total 0 00000100:00080000:0.0:1788864932.324430:0:12896:0:(import.c:65:import_set_state_nolock()) ffff9fdca0052800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788864932.324445:0:12896:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fdca0050000): rc 0 00000020:00080000:0.0:1788864932.324448:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9fdca5be4d40) has no exports 00000100:00100000:0.0:1788864932.324507:0:5830:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9fdca1edb200:5830] 2 exiting: rc = 0 00000100:00100000:1.0:1788864932.324603:0:5827:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9fdca15ec400:5827] 0 exiting: rc = 1 00000100:00100000:0.0:1788864932.324610:0:5828:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9fdca1eda400:5828] 1 exiting: rc = 0 00000020:00010000:2.0:1788864932.324654:0:11155:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9fdca0050000: total 0 00010000:00010000:2.0:1788864932.324676:0:11155:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fdca0050000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788864932.324720:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdc80030400/0xf8c13e2d0e9591e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf8c13e2d0e9591dc expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.324746:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdc80030000/0xf8c13e2d0e9591f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf8c13e2d0e9591ea expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.324757:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdc80031800/0xf8c13e2d0e958fcf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf8c13e2d0e958fc8 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.324770:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdb8213fe00/0xf8c13e2d0e95940c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf8c13e2d0e959405 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.324791:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcafc74a00/0xf8c13e2d0e95941a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf8c13e2d0e959413 expref: 5 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.324804:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdc80030a00/0xf8c13e2d0e95921b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf8c13e2d0e959214 expref: 4 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.324814:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdc80031000/0xf8c13e2d0e9591c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf8c13e2d0e9591c0 expref: 3 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.324822:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdc80031c00/0xf8c13e2d0e9591d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf8c13e2d0e9591ce expref: 2 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864932.324831:0:11155:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fdca0050000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1788864932.324857:0:11155:0:(genops.c:885:class_export_put()) final put ffff9fdca0050000/ad9c839d-b0de-4595-ae42-0c3c3a7e2f96 00010000:00010000:2.0:1788864932.324865:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864932.324867:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864932.324869:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788864932.324875:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdca0050000/ad9c839d-b0de-4595-ae42-0c3c3a7e2f96 for MGS 00000020:00000080:2.0:1788864932.324896:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fdca0052800 for MGS 00000100:00100000:0.0:1788864932.325381:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325390:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325402:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325408:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325414:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325421:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325427:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325432:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325437:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325442:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325447:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325452:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325457:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325462:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325467:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325472:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325477:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325482:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325487:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325493:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325498:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325503:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325508:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325518:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325526:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325531:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325538:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325543:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325549:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325554:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325561:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325566:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325572:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325577:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325582:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325587:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325592:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325603:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325608:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325613:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325618:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.325623:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.326728:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.326752:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.326758:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.326764:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.326769:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.326775:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.326781:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.326787:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.326792:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.326798:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.326803:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.326809:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.326814:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.326819:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.326824:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.326829:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.326834:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.326838:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.326843:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.326848:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.326853:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.326857:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1788864932.327512:0:12896:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788864932.327516:0:12896:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1788864932.329271:0:12896:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fdca2cb8a20 - data ffff9fdc8f3a5438/ffff9fdcbfe69c00 00000020:01000000:0.0:1788864932.329386:0:12896:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fdcb5300180 - data ffff9fdc82334360/ffff9fdca1f5d400 00000020:00000080:0.0:1788864932.329876:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e958ea9 00000020:00000080:0.0:1788864932.329884:0:12896:0:(genops.c:885:class_export_put()) final put ffff9fdc8861c800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788864932.329898:0:12896:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fdc8878e000 from MGS, refs=2 00000020:01000004:0.0:1788864932.329910:0:12896:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fdc8878e000 2 00000020:01000004:0.0:1788864932.329913:0:12896:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fdc8878e000 from MGS 00000020:00000080:0.0:1788864932.329934:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788864932.329941:0:12896:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788864932.329943:0:12896:0:(genops.c:885:class_export_put()) final put ffff9fdc8861f000/MGS 00000020:00000080:0.0:1788864932.329946:0:12896:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdc8861f000/MGS for MGS 00000020:01000000:0.0:1788864932.329953:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788864932.329999:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788864932.330003:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788864932.330008:0:12896:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788864932.330014:0:12896:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9fdc83523000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788864932.330019:0:12896:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9fdca1ff19c0) has exports, disconnecting them 00000020:00080000:0.0:1788864932.330024:0:12896:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9fdc83523000), last request at 1788864726 00000020:00000080:0.0:1788864932.330028:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e958f74 00000020:00080000:0.0:1788864932.330037:0:12896:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fdc83523000): rc 0 00000020:00000080:0.0:1788864932.330041:0:12896:0:(genops.c:885:class_export_put()) final put ffff9fdc83523000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788864932.330655:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdc8861c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788864932.330663:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdc83523000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788864932.331797:0:12896:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788864932.331803:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788864932.331807:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788864932.331813:0:12896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788864932.331975:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788864932.331981:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788864932.331987:0:12896:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fdc8878e000 1 00000020:00000080:1.0:1788864932.331993:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e958e9b 00000020:00000080:1.0:1788864932.332000:0:12896:0:(genops.c:885:class_export_put()) final put ffff9fdc8861b000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788864932.332004:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788864932.332009:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788864932.332012:0:12896:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788864932.332015:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9fdca14c99c0) has no exports 00000020:00000080:2.0:1788864932.332093:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fdc83527000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788864932.332100:0:36:0:(genops.c:885:class_export_put()) final put ffff9fdc83524800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788864932.332102:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdc83524800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788864932.332107:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788864932.332163:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdc8861b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788864932.376656:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788864932.376669:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788864932.376674:0:12896:0:(genops.c:885:class_export_put()) final put ffff9fdc86518000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788864932.376679:0:12896:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdc86518000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788864932.376729:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788864932.376896:0:12896:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fdc8878c800 00000020:01000000:2.0:1788864932.376917:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788864932.376921:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788864932.376925:0:12896:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788864932.376928:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9fdca1ff3380) has no exports 00000100:00100000:1.0:1788864932.377047:0:5835:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9fdca0074600:5835] 0 exiting: rc = 1 00000100:00100000:1.0:1788864932.377139:0:5837:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9fdca0075200:5837] 2 exiting: rc = 0 00000100:00100000:2.0:1788864932.378097:0:6705:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9fdb81195800:6705] 3 exiting: rc = 0 00000100:00100000:0.0:1788864932.382577:0:5836:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9fdca0074400:5836] 1 exiting: rc = 0 00000100:00100000:2.0:1788864932.383192:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383200:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383206:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383213:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383218:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383225:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383230:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383311:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383320:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383339:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383346:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383353:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383359:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383364:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383371:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383377:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383383:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383388:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383394:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383399:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383405:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383410:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383417:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383423:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383429:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383434:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383440:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383469:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383475:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383480:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383486:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383491:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383496:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383501:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383507:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383512:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383517:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383522:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383527:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383532:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383537:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383542:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383547:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383553:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383558:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383563:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383568:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383573:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383578:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383639:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383697:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383780:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383787:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383791:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383796:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383800:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383805:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383810:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383815:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383821:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383827:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383835:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383847:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.383853:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.390607:0:5838:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9fdca0075600:5838] 0 exiting: rc = 1 00000100:00100000:1.0:1788864932.390959:0:5839:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9fdca0049e00:5839] 1 exiting: rc = 0 00000100:00100000:2.0:1788864932.391181:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391190:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391196:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391204:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391211:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391217:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391223:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391229:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391235:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391252:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391258:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391264:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391271:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391275:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391280:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391286:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391290:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391295:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391300:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391305:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391309:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391314:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391319:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391337:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391344:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391350:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391355:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391360:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391366:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391372:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391377:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391383:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391388:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391406:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391411:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391416:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391422:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391428:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391433:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391438:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391443:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391447:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391452:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391458:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391462:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391467:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391472:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391477:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391481:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391486:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391490:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391494:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391499:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391504:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391509:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391515:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391520:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391525:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391530:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391535:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391540:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391546:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391550:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.391556:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.394315:0:5841:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9fdca0048c00:5841] 1 exiting: rc = 0 00000100:00100000:1.0:1788864932.401965:0:5840:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9fdca0049800:5840] 0 exiting: rc = 1 00000100:00100000:0.0:1788864932.403912:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.403924:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.403932:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.403937:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.403943:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.403949:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.403955:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.403961:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.403966:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.403977:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.403984:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.403989:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.403996:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404024:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404051:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404060:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404066:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404072:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404077:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404083:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404089:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404094:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404102:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404108:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404115:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404120:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404140:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404147:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404153:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404159:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404166:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404172:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404179:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404184:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404191:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404196:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404202:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404208:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404228:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.404235:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.406358:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.406372:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.406379:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.406385:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.406391:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.406397:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.406403:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.406409:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.406427:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.406436:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.406462:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.406470:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.406476:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.406482:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.406487:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.406493:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.406499:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.406506:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.406514:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.406522:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.406544:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.406553:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.406561:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.406569:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.431461:0:5842:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9fdca0048600:5842] 0 exiting: rc = 1 00000100:00100000:1.0:1788864932.431513:0:5843:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9fdca0048400:5843] 1 exiting: rc = 0 00000100:00100000:1.0:1788864932.436949:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.436958:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.436962:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.436967:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.436972:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.436978:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.436983:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.436988:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.437007:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.437012:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.437017:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.437022:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.437028:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.437034:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.437039:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.437044:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.437049:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.437055:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.437060:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.437065:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.437070:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.440725:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.440768:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.440774:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.440779:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.440783:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.440788:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.440792:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.440797:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.440801:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.440805:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.440810:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.440814:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.440818:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.440823:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.440828:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.440832:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.440836:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.440841:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.440846:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.440850:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.440855:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.441538:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.441559:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.441564:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.441569:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.441574:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.441579:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.441584:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.441589:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.441594:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.441598:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.441602:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.441607:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.441611:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.441615:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.441619:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.441624:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.441630:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.441635:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.441641:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.441645:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.441650:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.441655:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788864932.443105:0:5845:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9fdca0074000:5845] 1 exiting: rc = 0 00000100:00100000:2.0:1788864932.443354:0:5844:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9fdca0049a00:5844] 0 exiting: rc = 1 00000100:00100000:1.0:1788864932.443995:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444004:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444010:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444015:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444020:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444025:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444031:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444035:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444040:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444045:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444050:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444056:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444061:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444066:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444087:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444095:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444102:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444107:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444113:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444120:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444127:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444134:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444142:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444149:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444156:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444162:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444169:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444176:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444187:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444195:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444201:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444211:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444219:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444227:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444649:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444659:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444664:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444669:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444674:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444680:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444686:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444692:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444700:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444740:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444746:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444753:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444760:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444766:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444773:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444789:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444797:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444805:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444812:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444820:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444827:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444834:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444841:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444848:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444855:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444862:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444867:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444872:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444878:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.444883:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.445267:0:5846:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9fdca0074a00:5846] 0 exiting: rc = 1 00000100:00100000:0.0:1788864932.445526:0:5847:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9fdc90248800:5847] 1 exiting: rc = 0 00000100:00100000:1.0:1788864932.445677:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445684:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445690:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445697:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445723:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445731:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445748:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445754:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445759:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445767:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445774:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445780:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445787:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445795:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445802:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445810:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445816:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445823:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445830:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445837:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445854:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445861:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445868:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445874:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445881:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445888:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445895:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445902:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445908:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445915:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445922:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445929:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445938:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445949:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445960:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445966:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445976:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445982:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445988:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445993:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.445999:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.446005:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.446010:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.446015:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.446020:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.446025:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.446030:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.446035:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.446040:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.446045:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.446050:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.446054:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.446059:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.446185:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.446195:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.446207:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.446212:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.446217:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.446222:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.446227:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.446232:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.446248:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.446254:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.446259:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864932.447285:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9fdc90249800:5848] 0 exiting: rc = 1 00000100:00100000:0.0:1788864932.447477:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9fdc90248c00:5849] 1 exiting: rc = 0 00010000:00010000:2.0:1788864932.447638:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864932.447749:0:5850:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9fdca1aaca00:5850] 2 exiting: rc = 0 00000100:00100000:1.0:1788864932.447805:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447812:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447818:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447823:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447829:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447836:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447842:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447848:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447853:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447859:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447864:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447869:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447874:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447879:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447885:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447891:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447898:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447903:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447909:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447914:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447920:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447925:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447947:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447954:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447960:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447974:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447979:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447984:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447989:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.447995:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448000:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448005:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448011:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448017:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448022:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448027:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448032:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448038:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448044:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448049:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448055:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448061:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448065:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448071:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448076:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448082:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448103:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448109:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448114:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448119:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448124:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448130:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448135:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448141:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448146:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448152:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448157:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448163:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448168:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448173:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448193:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448199:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448205:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864932.448210:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788864932.453759:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788864932.453771:0:12896:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788864932.453778:0:12896:0:(genops.c:885:class_export_put()) final put ffff9fdc837ac000/MDS_uuid 00000020:00000080:0.0:1788864932.453782:0:12896:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdc837ac000/MDS_uuid for MDS 00000020:01000000:0.0:1788864932.453787:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788864932.453896:0:12896:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:3.0:1788864933.279660:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788864933.279669:0:7636:0:(genops.c:885:class_export_put()) final put ffff9fdc9081b800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788864933.279739:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1cf2dd0f-7f2d-465e-9303-244222bc89bf 00000020:00000080:3.0:1788864933.279742:0:7636:0:(genops.c:885:class_export_put()) final put ffff9fdc82ac3800/1cf2dd0f-7f2d-465e-9303-244222bc89bf 00000020:00000080:0.0:1788864933.279940:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdc9081b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788864933.279992:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdc82ac3800/1cf2dd0f-7f2d-465e-9303-244222bc89bf for lustre-OST0001 00000020:00000080:0.0:1788864933.280006:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fdc90818800 for lustre-OST0001 00000020:00000080:0.0:1788864933.280012:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fdc82ac3000 for lustre-OST0001 00010000:00010000:3.0:1788864933.512337:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864934.215369:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788864934.215400:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546660864:0@lo:400:kworker.0 00000400:00000100:1.0:1788864934.215455:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875760546660864 offset 0 length 224: 4 00000100:00100000:1.0:1788864934.215506:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546660992:0@lo:400:kworker.0 00000400:00000100:1.0:1788864934.215525:0:3300:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875760546660992 offset 0 length 224: 4 00000100:00100000:1.0:1788864934.215539:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788864934.215543:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546661120:0@lo:400:kworker.0 00000400:00000100:1.0:1788864934.215558:0:3300:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875760546661120 offset 0 length 224: 4 00010000:00010000:1.0:1788864934.532861:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788864935.370637:0:13049:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1788864935.383130:0:13049:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788864935.383176:0:13049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e9591dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9591e3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864935.383190:0:13049:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e9591dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e9591e3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864935.383198:0:13049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e9591dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf8c13e2d0e9591e3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864935.383205:0:13049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e9591dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf8c13e2d0e9591e3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864935.383229:0:13049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788864935.383234:0:13049:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788864935.383256:0:13049:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788864935.383267:0:13049:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fdb81924a80 x1875760546660992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864950 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864935.383290:0:13049:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788864935.383296:0:13049:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788864935.383319:0:13049:0:(import.c:65:import_set_state_nolock()) ffff9fdb81805000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788864935.383398:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546660992:0@lo:400:kworker.0 00010000:00010000:2.0:1788864935.383462:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864935.383469:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e9591dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf8c13e2d0e9591e3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864935.383476:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca4d15200 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1788864935.383480:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e9591dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf8c13e2d0e9591e3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864935.383488:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e9591dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf8c13e2d0e9591e3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788864935.383495:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e9591dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf8c13e2d0e9591e3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864935.383500:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788864935.383503:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788864935.383505:0:5823:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788864935.383529:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e9591dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf8c13e2d0e9591e3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864935.383535:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788864935.383563:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e9591dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf8c13e2d0e9591e3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864935.383570:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15200/0xf8c13e2d0e9591dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf8c13e2d0e9591e3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864935.383582:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864935.383584:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864935.383586:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864935.383599:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875760546661248:0@lo:39:umount.0 00000400:00000100:2.0:1788864935.383658:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875760546661248 offset 0 length 224: 4 00000100:00100000:1.0:1788864935.383792:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546661376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788864935.383828:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864935.383906:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546661376 00000100:00100000:2.0:1788864935.383914:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546661376 00000100:00100000:2.0:1788864935.383958:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788864935.383965:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81924a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3302:x1875760546661376:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788864935.383971:0:5820:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788864935 with bad export cookie 17924676355150417605 00000100:00100000:2.0:1788864935.392161:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81924a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3302:x1875760546661376:12345-0@lo:103:ldlm_bl.0 Request processed in 8186us (8324us total) trans 0 rc -107/-107 00000100:00080000:1.0:1788864935.392170:0:3302:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.113@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1788864935.392175:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788864935.392176:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9fdc837ac800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788864935.392179:0:3302:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.113@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788864935.398856:0:3302:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.113@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788864935.398862:0:3302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788864935.398873:0:3302:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fdb81925880 x1875760546660864/t0(0) o400->MGC192.168.203.113@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788864950 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864935.398888:0:3302:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fdcac9cf800 x1875760546661376/t0(0) o103->MGC192.168.203.113@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788864951 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788864935.398896:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788864935.398914:0:3302:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788864935.398916:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788864935.398919:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9fdc837ac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788864935.398924:0:3302:0:(import.c:545:import_select_connection()) MGC192.168.203.113@tcp: connect to NID 0@lo last attempt 148 00000100:00080000:1.0:1788864935.398938:0:3302:0:(import.c:666:import_select_connection()) MGC192.168.203.113@tcp: import ffff9fdc837ac800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788864935.399051:0:3302:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fdcac9ced80 x1875760546661504/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788864935.399119:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3299:1875760546661504:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1788864935.399167:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875760546661504 offset 0 length 520: 4 00000100:00100000:2.0:1788864935.399471:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546660864:0@lo:400:kworker.0 00000100:00100000:2.0:1788864935.399495:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3302:1875760546661376:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788864935.557151:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864936.582067:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788864936.848521:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788864936.848535:0:6709:0:(genops.c:885:class_export_put()) final put ffff9fdb8119a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788864936.848679:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdb8119a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788864936.848780:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fdb81198000 for lustre-OST0000 00010000:00010000:2.0:1788864937.605657:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864938.629038:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788864939.332931:0:13016:0:(pinger.c:229:ptlrpc_pinger_process_import()) ad9c839d-b0de-4595-ae42-0c3c3a7e2f96->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788864939.332943:0:13016:0:(pinger.c:247:ptlrpc_pinger_process_import()) ad9c839d-b0de-4595-ae42-0c3c3a7e2f96->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788864939.333168:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875760546661632:0@lo:400:kworker.0 00000400:00000100:3.0:1788864939.333256:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875760546661632 offset 0 length 224: 4 00010000:00010000:1.0:1788864939.652988:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788864940.357421:0:13016:0:(pinger.c:229:ptlrpc_pinger_process_import()) ad9c839d-b0de-4595-ae42-0c3c3a7e2f96->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788864940.357434:0:13016:0:(pinger.c:247:ptlrpc_pinger_process_import()) ad9c839d-b0de-4595-ae42-0c3c3a7e2f96->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788864940.357585:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788864940.357614:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875760546661760:0@lo:400:kworker.0 00000400:00000100:2.0:1788864940.357699:0:3301:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875760546661760 offset 0 length 224: 4 00010000:00010000:2.0:1788864940.677110:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864941.700917:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864942.725150:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864943.750355:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864944.772879:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788864945.476852:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) ad9c839d-b0de-4595-ae42-0c3c3a7e2f96->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788864945.476864:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) ad9c839d-b0de-4595-ae42-0c3c3a7e2f96->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788864945.476970:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788864945.476987:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546661888:0@lo:400:kworker.0 00000400:00000100:3.0:1788864945.477037:0:3300:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875760546661888 offset 0 length 224: 4 00010000:00010000:1.0:1788864945.796855:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864945.989990:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788864935/real 1788864935] req@ffff9fdcac9ced80 x1875760546661504/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788864945 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864945.990043:0:3299:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fdcac9ced80 x1875760546661504/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788864945 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864945.990055:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788864935/real 1788864935] req@ffff9fdc86eb8380 x1875760546661248/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788864945 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864945.990066:0:3299:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fdc86eb8380 x1875760546661248/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788864945 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788864945.990082:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fdc837ac800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788864945.990112:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788864945.990116:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3299:1875760546661504:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1788864945.990123:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fdb81805000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788864945.990142:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875760546661248:0@lo:39:umount.0 00000100:00080000:3.0:1788864945.990239:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) ad9c839d-b0de-4595-ae42-0c3c3a7e2f96->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788864945.990245:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788864945.990248:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fdc837ac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788864945.990253:0:36:0:(import.c:545:import_select_connection()) MGC192.168.203.113@tcp: connect to NID 0@lo last attempt 358 00000100:00080000:3.0:1788864945.990258:0:36:0:(import.c:630:import_select_connection()) MGC192.168.203.113@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788864945.990270:0:36:0:(import.c:666:import_select_connection()) MGC192.168.203.113@tcp: import ffff9fdc837ac800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788864945.990299:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fdc86ebbb80 x1875760546662016/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788864945.990381:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875760546662144:0@lo:400:kworker.0 00000400:00000100:1.0:1788864945.990424:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875760546662144 offset 0 length 224: 4 00000100:00100000:2.0:1788864945.990516:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86ebbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3299:1875760546662016:0@lo:250:kworker.0 00000400:00000100:2.0:1788864945.990537:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875760546662016 offset 0 length 520: 4 00000100:00080000:0.0:1788864945.991304:0:13049:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788864945.991310:0:13049:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788864945.991315:0:13049:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788864945.992188:0:13049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fa00/0xf8c13e2d0e9591ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9591f1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864945.992205:0:13049:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fa00/0xf8c13e2d0e9591ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e9591f1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864945.992212:0:13049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fa00/0xf8c13e2d0e9591ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf8c13e2d0e9591f1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864945.992220:0:13049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fa00/0xf8c13e2d0e9591ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf8c13e2d0e9591f1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864945.992243:0:13049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788864945.992250:0:13049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fc00/0xf8c13e2d0e959413 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95941a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864945.992258:0:13049:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fc00/0xf8c13e2d0e959413 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95941a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864945.992264:0:13049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fc00/0xf8c13e2d0e959413 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf8c13e2d0e95941a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864945.992287:0:13049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fc00/0xf8c13e2d0e959413 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf8c13e2d0e95941a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864945.992309:0:13049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788864945.992366:0:13049:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788864945.992389:0:13049:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788864945.992394:0:13049:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788864945.992399:0:13049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788864945.992404:0:13049:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788864945.992409:0:13049:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9fdc9f64cd40) has no exports 00000020:00080000:0.0:1788864945.992434:0:13049:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9fdc9f64cd40) has no exports 00010000:00010000:2.0:1788864945.992538:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788864945.992546:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fa00/0xf8c13e2d0e9591ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf8c13e2d0e9591f1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864945.992553:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213fa00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1788864945.992555:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fa00/0xf8c13e2d0e9591ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf8c13e2d0e9591f1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864945.992562:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fa00/0xf8c13e2d0e9591ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf8c13e2d0e9591f1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788864945.992575:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fa00/0xf8c13e2d0e9591ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf8c13e2d0e9591f1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864945.992578:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788864945.992580:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788864945.992581:0:5823:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788864945.992592:0:5823:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fdc837ac800 00010000:00010000:2.0:1788864945.992597:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fa00/0xf8c13e2d0e9591ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf8c13e2d0e9591f1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864945.992602:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fa00/0xf8c13e2d0e9591ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf8c13e2d0e9591f1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864945.992629:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864945.992633:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fc00/0xf8c13e2d0e959413 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf8c13e2d0e95941a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864945.992650:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213fc00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1788864945.992654:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fc00/0xf8c13e2d0e959413 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf8c13e2d0e95941a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864945.992661:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fc00/0xf8c13e2d0e959413 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf8c13e2d0e95941a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788864945.992667:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fc00/0xf8c13e2d0e959413 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf8c13e2d0e95941a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864945.992672:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788864945.992674:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788864945.992682:0:5823:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788864945.992689:0:5823:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fdc837ac800 00010000:00010000:2.0:1788864945.992692:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fc00/0xf8c13e2d0e959413 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf8c13e2d0e95941a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864945.992699:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fc00/0xf8c13e2d0e959413 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf8c13e2d0e95941a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864945.992750:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864945.992752:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864945.992754:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788864945.994203:0:13049:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fdca1be8de0 - data ffff9fdcb9bdd510/ffff9fdcbfecbc00 00000020:01000000:0.0:1788864945.994324:0:13049:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fdca1bda0c0 - data ffff9fdc8f079bd0/ffff9fdb813fb000 00010000:00010000:3.0:1788864945.995977:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788864946.009470:0:13049:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788864946.033303:0:13049:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e958feb 00000020:00000080:1.0:1788864946.033314:0:13049:0:(genops.c:885:class_export_put()) final put ffff9fdb81199000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788864946.033338:0:13049:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fdcacbf0000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788864946.033341:0:13049:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fdcacbf0000 2 00000020:01000004:1.0:1788864946.033345:0:13049:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fdcacbf0000 from lustre-OST0000 00000020:00000080:1.0:1788864946.033371:0:13049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788864946.033380:0:13049:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788864946.033384:0:13049:0:(genops.c:885:class_export_put()) final put ffff9fdcbdc74000/lustre-OST0000_UUID 00000020:00000080:1.0:1788864946.033387:0:13049:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcbdc74000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788864946.033394:0:13049:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788864946.033434:0:13049:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788864946.033438:0:13049:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788864946.033442:0:13049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788864946.033447:0:13049:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788864946.033454:0:13049:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9fdb81803000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788864946.033461:0:13049:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff9fdca1ff0000) has exports, disconnecting them 00000020:00080000:1.0:1788864946.033465:0:13049:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9fdb81803000), last request at 1788864740 00000020:00000080:1.0:1788864946.033469:0:13049:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e959015 00000020:00080000:1.0:1788864946.033491:0:13049:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fdb81803000): rc 0 00000020:00000080:1.0:1788864946.033496:0:13049:0:(genops.c:885:class_export_put()) final put ffff9fdb81803000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788864946.034349:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdb81199000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788864946.034359:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdb81803000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788864946.048291:0:13049:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788864946.048299:0:13049:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788864946.048303:0:13049:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788864946.048310:0:13049:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788864946.048499:0:13049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788864946.048508:0:13049:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788864946.048514:0:13049:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fdcacbf0000 1 00000020:00000080:1.0:1788864946.048521:0:13049:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e958fa5 00000020:00000080:3.0:1788864946.048619:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fdb81805000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788864946.048627:0:36:0:(genops.c:885:class_export_put()) final put ffff9fdca2cfd000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788864946.048631:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdca2cfd000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788864946.048637:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788864946.048813:0:13049:0:(genops.c:885:class_export_put()) final put ffff9fdcc0138000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788864946.048828:0:13049:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788864946.048833:0:13049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788864946.048837:0:13049:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788864946.048840:0:13049:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9fdcc08019c0) has no exports 00000020:00000080:3.0:1788864946.051628:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcc0138000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788864946.078036:0:13049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788864946.078052:0:13049:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788864946.078058:0:13049:0:(genops.c:885:class_export_put()) final put ffff9fdc837aa000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788864946.078063:0:13049:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdc837aa000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788864946.078077:0:13049:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788864946.078384:0:13049:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fdc837ad000 00000020:02000400:0.0:1788864946.078427:0:13049:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788864946.821933:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864947.844852:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788864948.284450:0:13204:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788864948.287971:0:13204:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788864948.288034:0:13204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15a00/0xf8c13e2d0e9591c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9591c7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864948.288046:0:13204:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15a00/0xf8c13e2d0e9591c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e9591c7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864948.288051:0:13204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15a00/0xf8c13e2d0e9591c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf8c13e2d0e9591c7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864948.288055:0:13204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15a00/0xf8c13e2d0e9591c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf8c13e2d0e9591c7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864948.288070:0:13204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788864948.288074:0:13204:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788864948.288103:0:13204:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788864948.288112:0:13204:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fdb81924e00 x1875760546661120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864950 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864948.288129:0:13204:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fdc9f45df80 x1875760546661632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864955 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864948.288139:0:13204:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fdc9f45d880 x1875760546661760/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864956 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864948.288149:0:13204:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fdcac9cf800 x1875760546661888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864961 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864948.288155:0:13204:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fdc86eb8380 x1875760546662144/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864961 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864948.288164:0:13204:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1788864948.288177:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546661888:0@lo:400:kworker.0 00000100:00100000:1.0:1788864948.288186:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875760546661632:0@lo:400:kworker.0 00000100:00100000:2.0:1788864948.288197:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546661120:0@lo:400:kworker.0 00010000:00010000:3.0:1788864948.288305:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788864948.288313:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15a00/0xf8c13e2d0e9591c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf8c13e2d0e9591c7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864948.288321:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca4d15a00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:3.0:1788864948.288324:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15a00/0xf8c13e2d0e9591c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf8c13e2d0e9591c7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864948.288344:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15a00/0xf8c13e2d0e9591c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf8c13e2d0e9591c7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788864948.288352:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15a00/0xf8c13e2d0e9591c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf8c13e2d0e9591c7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864948.288358:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788864948.288361:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788864948.288364:0:5824:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788864948.288377:0:5824:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fdc837ac800 00010000:00010000:3.0:1788864948.288381:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15a00/0xf8c13e2d0e9591c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf8c13e2d0e9591c7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864948.288388:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15a00/0xf8c13e2d0e9591c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf8c13e2d0e9591c7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864948.288402:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864948.288405:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864948.288407:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864948.288655:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875760546661760:0@lo:400:kworker.0 00000100:00100000:1.0:1788864948.288676:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875760546662144:0@lo:400:kworker.0 00000100:00080000:1.0:1788864948.288686:0:13204:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788864948.288721:0:13204:0:(import.c:65:import_set_state_nolock()) ffff9fdb81802000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788864948.288953:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875760546662272:0@lo:39:umount.0 00000400:00000100:2.0:1788864948.289030:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875760546662272 offset 0 length 224: 4 00010000:00010000:1.0:1788864948.869236:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864949.893225:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864950.916916:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788864951.109413:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) ad9c839d-b0de-4595-ae42-0c3c3a7e2f96->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788864951.109427:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) ad9c839d-b0de-4595-ae42-0c3c3a7e2f96->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788864951.940891:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864952.967804:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864953.990063:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864955.012915:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864956.037027:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788864956.228814:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) ad9c839d-b0de-4595-ae42-0c3c3a7e2f96->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788864956.228825:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) ad9c839d-b0de-4595-ae42-0c3c3a7e2f96->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788864957.060788:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864958.085421:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864958.533198:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788864948/real 1788864948] req@ffff9fdb81924000 x1875760546662272/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788864958 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864958.533281:0:3299:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fdb81924000 x1875760546662272/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788864958 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788864958.533298:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fdb81802000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788864958.533316:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875760546662272:0@lo:39:umount.0 00000100:00080000:1.0:1788864958.534350:0:13204:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788864958.534356:0:13204:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788864958.534361:0:13204:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788864958.535867:0:13204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f000/0xf8c13e2d0e9591ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e9591d5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864958.535902:0:13204:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f000/0xf8c13e2d0e9591ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e9591d5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864958.535909:0:13204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f000/0xf8c13e2d0e9591ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf8c13e2d0e9591d5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864958.535916:0:13204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f000/0xf8c13e2d0e9591ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf8c13e2d0e9591d5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864958.536008:0:13204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788864958.536015:0:13204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e959405 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95940c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864958.536023:0:13204:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e959405 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95940c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864958.536029:0:13204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e959405 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf8c13e2d0e95940c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864958.536036:0:13204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e959405 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf8c13e2d0e95940c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864958.537794:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788864958.537820:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f000/0xf8c13e2d0e9591ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf8c13e2d0e9591d5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864958.537831:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213f000 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1788864958.537835:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f000/0xf8c13e2d0e9591ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf8c13e2d0e9591d5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864958.537844:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f000/0xf8c13e2d0e9591ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf8c13e2d0e9591d5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788864958.537851:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f000/0xf8c13e2d0e9591ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf8c13e2d0e9591d5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864958.537856:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788864958.537859:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1788864958.537870:0:5823:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fdc837ac800 00010000:00010000:2.0:1788864958.537874:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f000/0xf8c13e2d0e9591ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf8c13e2d0e9591d5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864958.537881:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdb8213f000/0xf8c13e2d0e9591ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf8c13e2d0e9591d5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864958.537898:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864958.537901:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e959405 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf8c13e2d0e95940c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864958.537907:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75c00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1788864958.537910:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e959405 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf8c13e2d0e95940c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864958.537916:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e959405 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf8c13e2d0e95940c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788864958.537945:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e959405 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf8c13e2d0e95940c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864958.537951:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788864958.537953:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788864958.537958:0:5823:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fdc837ac800 00010000:00010000:2.0:1788864958.537962:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e959405 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf8c13e2d0e95940c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864958.537969:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864958.537971:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864958.537973:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864958.542614:0:13204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788864958.542629:0:13204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e959405 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf8c13e2d0e95940c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788864958.542655:0:13204:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1788864958.542665:0:13204:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1788864958.542667:0:13204:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788864958.542730:0:13204:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788864958.542734:0:13204:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788864958.542742:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788864958.542748:0:13204:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788864958.542752:0:13204:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9fdca14c8000) has no exports 00000020:00080000:1.0:1788864958.542777:0:13204:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9fdca14c8000) has no exports 00000020:01000000:1.0:1788864958.544419:0:13204:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fdca2cb8c60 - data ffff9fdcaff83d80/ffff9fdcbc832000 00000020:01000000:1.0:1788864958.544602:0:13204:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fdca2cb8d20 - data ffff9fdcaff50af8/ffff9fdcc00b8c00 00010000:00010000:3.0:1788864958.549241:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788864958.561248:0:13204:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788864958.594505:0:13204:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e9590c4 00000020:00000080:1.0:1788864958.594514:0:13204:0:(genops.c:885:class_export_put()) final put ffff9fdcb105e800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788864958.594534:0:13204:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fdcbfd92000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788864958.594538:0:13204:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fdcbfd92000 2 00000020:01000004:1.0:1788864958.594541:0:13204:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fdcbfd92000 from lustre-OST0001 00000020:00000080:1.0:1788864958.594571:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788864958.594581:0:13204:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788864958.594584:0:13204:0:(genops.c:885:class_export_put()) final put ffff9fdcbfe67000/lustre-OST0001_UUID 00000020:00000080:1.0:1788864958.594586:0:13204:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcbfe67000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788864958.594595:0:13204:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788864958.594682:0:13204:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import ad9c839d-b0de-4595-ae42-0c3c3a7e2f96->MGS 00010000:00010000:1.0:1788864958.594697:0:13204:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15000/0xf8c13e2d0e958fc8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf8c13e2d0e958fcf expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788864958.594732:0:13204:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15000/0xf8c13e2d0e958fc8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf8c13e2d0e958fcf expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788864958.594738:0:13204:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788864958.594741:0:13204:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788864958.594744:0:13204:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788864958.594757:0:13204:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fdc837ac800 00010000:00010000:1.0:1788864958.594761:0:13204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdca4d15000/0xf8c13e2d0e958fc8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf8c13e2d0e958fcf expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864958.594786:0:13204:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdc80031200/0xf8c13e2d0e959214 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf8c13e2d0e95921b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788864958.594912:0:13204:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdc80031200/0xf8c13e2d0e959214 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf8c13e2d0e95921b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788864958.594920:0:13204:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788864958.594922:0:13204:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788864958.594924:0:13204:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788864958.594935:0:13204:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fdc837ac800 00010000:00010000:1.0:1788864958.594938:0:13204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdc80031200/0xf8c13e2d0e959214 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf8c13e2d0e95921b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788864958.594954:0:13204:0:(import.c:65:import_set_state_nolock()) ffff9fdc837ac800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788864958.594959:0:13204:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788864958.594961:0:13204:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788864958.594962:0:13204:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788864958.594966:0:13204:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788864958.594977:0:13204:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fdc86ebbb80 x1875760546662016/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788864960 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788864958.594992:0:13204:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788864958.594995:0:13204:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000020:00000080:3.0:1788864958.595049:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcb105e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1788864958.595237:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86ebbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ad9c839d-b0de-4595-ae42-0c3c3a7e2f96:3299:1875760546662016:0@lo:250:kworker.0 10000000:01000000:3.0:1788864958.595306:0:13204:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788864958.595313:0:13204:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e958eb7 00000020:00000080:3.0:1788864958.595318:0:13204:0:(genops.c:885:class_export_put()) final put ffff9fdc837ae000/ad9c839d-b0de-4595-ae42-0c3c3a7e2f96 00000020:01000000:3.0:1788864958.595332:0:13204:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.113@tcp (flags='') 00000020:00000080:3.0:1788864958.595337:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788864958.595347:0:13204:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.113@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788864958.595351:0:13204:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9fdca1ff4d40) has no exports 00000020:00000080:2.0:1788864958.595401:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdc837ae000/ad9c839d-b0de-4595-ae42-0c3c3a7e2f96 for MGC192.168.203.113@tcp 10000000:01000000:1.0:1788864958.595647:0:5832:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788864958.595739:0:13204:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.203.113@tcp: client import never connected 00000100:00080000:3.0:1788864958.595742:0:13204:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788864958.595744:0:13204:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788864958.595746:0:13204:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788864958.595747:0:13204:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788864958.595777:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788864958.595781:0:13204:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.113@tcp (uuid ad9c839d-b0de-4595-ae42-0c3c3a7e2f96) 00000020:01000000:3.0:1788864958.595786:0:13204:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788864958.595790:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788864958.595869:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fdc837ac800 for MGC192.168.203.113@tcp 00000020:00000080:2.0:1788864958.595875:0:36:0:(genops.c:885:class_export_put()) final put ffff9fdc837af000/ad9c839d-b0de-4595-ae42-0c3c3a7e2f96 00000020:00000080:2.0:1788864958.595877:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdc837af000/ad9c839d-b0de-4595-ae42-0c3c3a7e2f96 for MGC192.168.203.113@tcp 00000020:01000000:2.0:1788864958.595882:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.113@tcp (ad9c839d-b0de-4595-ae42-0c3c3a7e2f96) 00000020:00000080:3.0:1788864958.596317:0:13204:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788864958.596323:0:13204:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9fdca2cff800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788864958.596328:0:13204:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff9fdc9099b380) has exports, disconnecting them 00000020:00080000:3.0:1788864958.596332:0:13204:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9fdca2cff800), last request at 1788864755 00000020:00000080:3.0:1788864958.596336:0:13204:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e9590ee 00000020:00080000:3.0:1788864958.596348:0:13204:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fdca2cff800): rc 0 00000020:00000080:3.0:1788864958.596351:0:13204:0:(genops.c:885:class_export_put()) final put ffff9fdca2cff800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788864958.597401:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdca2cff800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788864958.597760:0:13204:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788864958.597765:0:13204:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788864958.597768:0:13204:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788864958.597772:0:13204:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788864958.597956:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1788864958.598115:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fdb81802000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788864958.598331:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788864958.598533:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1788864958.598662:0:5819:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9fdca15ed000:5819] 1 exiting: rc = 0 00000100:00100000:1.0:1788864958.598783:0:5818:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9fdca15eca00:5818] 0 exiting: rc = 1 00000100:00100000:2.0:1788864958.598923:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.599171:0:5820:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9fdca15ede00:5820] 0 exiting: rc = 1 00000100:00100000:1.0:1788864958.601103:0:5822:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9fdca15ec200:5822] 2 exiting: rc = 0 00000100:00100000:1.0:1788864958.601190:0:5821:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9fdca15ec800:5821] 1 exiting: rc = 0 00000100:00100000:2.0:1788864958.601637:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601653:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601659:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601669:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601675:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601681:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601687:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601693:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601699:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601729:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601735:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601741:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601747:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601753:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601759:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601765:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601771:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601776:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601781:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601786:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601792:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601797:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601803:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601808:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601814:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601819:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601823:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601829:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601834:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601840:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601845:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601851:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601856:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601862:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601867:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601872:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601886:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601891:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601896:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601901:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601906:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601911:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601917:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601922:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601927:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601932:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601938:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601943:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601948:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601954:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601959:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601964:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601969:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601975:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601980:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601985:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601990:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.601994:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.602115:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.602122:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.602127:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.602133:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.602137:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.602143:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788864958.603873:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788864958.603884:0:13204:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788864958.603890:0:13204:0:(genops.c:885:class_export_put()) final put ffff9fdca2cf8800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788864958.603894:0:13204:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdca2cf8800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788864958.603899:0:13204:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1788864958.603946:0:13204:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fdcbfd92000 1 00000020:00000080:2.0:1788864958.603959:0:13204:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf8c13e2d0e959093 00000020:00000080:2.0:1788864958.603965:0:13204:0:(genops.c:885:class_export_put()) final put ffff9fdcbffe9000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788864958.603972:0:13204:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788864958.603976:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788864958.603980:0:13204:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788864958.603984:0:13204:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9fdc9f64b380) has no exports 00000020:00000080:1.0:1788864958.604573:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcbffe9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788864958.627117:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788864958.627131:0:13204:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788864958.627136:0:13204:0:(genops.c:885:class_export_put()) final put ffff9fdcbfd91000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788864958.627141:0:13204:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcbfd91000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788864958.627150:0:13204:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788864958.627331:0:13204:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fdcbfd94000 00000020:01000000:2.0:1788864958.627348:0:13204:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788864958.627352:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788864958.627356:0:13204:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788864958.627360:0:13204:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9fdc9f648000) has no exports 00000020:00000080:2.0:1788864958.627382:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788864958.627386:0:13204:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788864958.627389:0:13204:0:(genops.c:885:class_export_put()) final put ffff9fdcc013d000/OSS_uuid 00000020:00000080:2.0:1788864958.627391:0:13204:0:(genops.c:844:class_export_destroy()) destroying export ffff9fdcc013d000/OSS_uuid for OSS 00000020:01000000:2.0:1788864958.627396:0:13204:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788864958.627460:0:6682:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9fdcc1636c00:6682] 0 exiting: rc = 1 00000100:00100000:3.0:1788864958.629130:0:6684:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9fdcc1636600:6684] 1 exiting: rc = 0 00000100:00100000:0.0:1788864958.629275:0:6685:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9fdc90248e00:6685] 2 exiting: rc = 0 00000100:00080000:2.0:1788864958.629413:0:5831:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788864958.636700:0:8199:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9fdb813c8c00:8199] 3 exiting: rc = 0 00000100:00100000:2.0:1788864958.638381:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638391:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638397:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638405:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638409:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638413:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638417:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638422:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638427:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638431:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638436:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638455:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638459:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638465:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638469:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638475:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638480:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638485:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638490:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638495:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638500:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638505:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638510:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638515:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638520:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638524:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638530:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638535:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638539:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638544:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638549:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638568:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638573:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638579:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638584:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638589:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638594:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638600:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638605:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638610:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638615:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638620:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638625:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638630:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638635:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638640:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638654:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638661:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638666:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638672:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638677:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638683:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638689:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638693:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638698:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638721:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638728:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638735:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638740:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638747:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638753:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638758:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638763:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.638768:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.639724:0:6687:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9fdca5a43800:6687] 1 exiting: rc = 0 00000100:00100000:1.0:1788864958.639964:0:6686:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9fdca5a43a00:6686] 0 exiting: rc = 1 00000100:00100000:3.0:1788864958.640228:0:10234:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9fdcac5ef400:10234] 2 exiting: rc = 0 00000100:00100000:2.0:1788864958.640359:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640367:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640372:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640376:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640381:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640385:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640390:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640395:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640399:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640404:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640409:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640414:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640419:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640424:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640430:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640434:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640448:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640454:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640459:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640463:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640468:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640472:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640477:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640482:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640487:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640492:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640498:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640502:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640507:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640513:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640518:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640523:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640529:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640534:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640539:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640544:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640548:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640567:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640573:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640578:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640583:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640589:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640594:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640599:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640604:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640608:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640613:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640618:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640622:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640627:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640633:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640644:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640649:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640654:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640658:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640663:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640668:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640675:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640679:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640684:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640689:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640694:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640699:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.640723:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.641670:0:6689:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9fdc9f449400:6689] 1 exiting: rc = 0 00000100:00100000:1.0:1788864958.641920:0:6688:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9fdc9f449000:6688] 0 exiting: rc = 1 00000100:00100000:1.0:1788864958.642089:0:6690:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9fdc9f449e00:6690] 2 exiting: rc = 0 00000100:00100000:2.0:1788864958.642355:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642362:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642367:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642372:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642377:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642382:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642388:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642393:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642397:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642402:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642408:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642413:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642418:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642424:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642433:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642438:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642443:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642448:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642456:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642461:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642467:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642485:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642502:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642509:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642515:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642521:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642526:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642532:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642537:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642543:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642548:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642679:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642687:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642693:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642698:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642731:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642738:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642744:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642749:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642754:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642760:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642765:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642771:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642777:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642783:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642788:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642793:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642800:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642804:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642810:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642815:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642821:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642826:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642832:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642837:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642843:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642856:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642861:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642867:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642873:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642879:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642884:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642889:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.642902:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.647774:0:6692:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9fdca1e78600:6692] 1 exiting: rc = 0 00000100:00100000:1.0:1788864958.647901:0:6691:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9fdca1e79400:6691] 0 exiting: rc = 1 00000100:00100000:2.0:1788864958.648264:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648271:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648276:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648282:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648286:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648291:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648295:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648300:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648305:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648310:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648315:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648320:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648325:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648331:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648335:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648341:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648346:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648351:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648355:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648361:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648366:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648371:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648377:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648382:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648388:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648393:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648412:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648418:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648423:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648428:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648433:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648437:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648442:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648447:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648451:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648455:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648460:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648465:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648470:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648474:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648479:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648483:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648488:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648493:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648498:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648503:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648508:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648513:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648517:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648522:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648526:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648531:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648536:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648541:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648545:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648549:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648564:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648571:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648576:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648580:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648585:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648597:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648601:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.648606:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788864958.652186:0:6693:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9fdc8721ca00:6693] 0 exiting: rc = 1 00000100:00100000:0.0:1788864958.653052:0:6694:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9fdca007dc00:6694] 1 exiting: rc = 0 00000100:00100000:2.0:1788864958.653343:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653351:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653368:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653376:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653382:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653388:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653394:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653407:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653414:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653420:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653425:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653431:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653437:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653442:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653450:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653459:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653465:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653471:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653480:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653503:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653510:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653515:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653521:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653526:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653532:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653538:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653543:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653549:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653566:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653572:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653577:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653599:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653615:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653622:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653628:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653634:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653640:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653646:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653652:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653658:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653668:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653674:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653680:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653699:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653733:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653742:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653768:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653778:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653783:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653789:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653794:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653800:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653805:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653946:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653952:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.653975:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.654998:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.655014:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.655021:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.655028:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.655033:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.655039:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.655045:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788864958.655163:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788864958.681906:0:13204:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788864975.782430:0:13820:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788864984.366938:0:14283:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788864984.366942:0:14283:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788864984.367065:0:14283:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fdb812fc800 00000020:01000004:3.0:1788864984.367080:0:14283:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788864984.367087:0:14283:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788864984.367099:0:14283:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9fdc90998000) 00000020:00000080:3.0:1788864984.367110:0:14283:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788864984.398638:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788864984.402503:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788864984.403081:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 421: rc = 0 00100000:10000000:2.0:1788864984.403188:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 421: rc = 0 00100000:10000000:2.0:1788864984.403400:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788864984.403469:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 421: rc = 0 00100000:10000000:2.0:1788864984.403621:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 421: rc = 0 00100000:10000000:2.0:1788864984.403758:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 421: rc = 0 00100000:10000000:2.0:1788864984.403871:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 421: rc = 0 00100000:10000000:2.0:1788864984.404487:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 423: rc = 0 00100000:10000000:2.0:1788864984.406091:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 559: rc = 0 00100000:10000000:2.0:1788864984.406196:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 559: rc = 0 00100000:10000000:2.0:1788864984.407472:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 648: rc = 0 00100000:10000000:2.0:1788864984.407769:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 648: rc = 0 00100000:10000000:2.0:1788864984.408539:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 648: rc = 0 00100000:10000000:2.0:1788864984.408956:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 648: rc = 0 00100000:10000000:2.0:1788864984.409441:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 648: rc = 0 00100000:10000000:2.0:1788864984.409696:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 648: rc = 0 00100000:10000000:2.0:1788864984.410325:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 648: rc = 0 00100000:10000000:2.0:1788864984.410589:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 648: rc = 0 00100000:10000000:2.0:1788864984.411074:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 648: rc = 0 00100000:10000000:2.0:1788864984.411433:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 648: rc = 0 00100000:10000000:2.0:1788864984.411694:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 648: rc = 0 00100000:10000000:2.0:1788864984.412178:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 648: rc = 0 00100000:10000000:2.0:1788864984.415097:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 580: rc = 0 00100000:10000000:2.0:1788864984.415506:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 580: rc = 0 00100000:10000000:2.0:1788864984.416477:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 580: rc = 0 00100000:10000000:2.0:1788864984.416946:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 580: rc = 0 00100000:10000000:2.0:1788864984.418855:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 580: rc = 0 00100000:10000000:2.0:1788864984.419330:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 580: rc = 0 00100000:10000000:2.0:1788864984.419596:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 580: rc = 0 00100000:10000000:2.0:1788864984.420207:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 580: rc = 0 00100000:10000000:2.0:1788864984.420634:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 580: rc = 0 00100000:10000000:2.0:1788864984.422238:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 580: rc = 0 00100000:10000000:2.0:1788864984.422515:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 580: rc = 0 00100000:10000000:2.0:1788864984.422866:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 580: rc = 0 00100000:10000000:2.0:1788864984.423232:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 580: rc = 0 00100000:10000000:2.0:1788864984.423497:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 580: rc = 0 00100000:10000000:2.0:1788864984.424166:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 580: rc = 0 00100000:10000000:2.0:1788864984.424424:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 580: rc = 0 00100000:10000000:2.0:1788864984.424680:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 580: rc = 0 00100000:10000000:2.0:1788864984.425183:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 580: rc = 0 00100000:10000000:2.0:1788864984.425434:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 580: rc = 0 00100000:10000000:2.0:1788864984.425663:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 580: rc = 0 00100000:10000000:2.0:1788864984.426247:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 580: rc = 0 00100000:10000000:2.0:1788864984.426526:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 580: rc = 0 00100000:10000000:2.0:1788864984.427179:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 580: rc = 0 00100000:10000000:2.0:1788864984.427443:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 580: rc = 0 00100000:10000000:2.0:1788864984.427691:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 580: rc = 0 00100000:10000000:3.0:1788864984.428283:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 580: rc = 0 00100000:10000000:3.0:1788864984.428545:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 580: rc = 0 00100000:10000000:3.0:1788864984.428965:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 580: rc = 0 00100000:10000000:3.0:1788864984.429500:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 580: rc = 0 00100000:10000000:3.0:1788864984.430320:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 580: rc = 0 00100000:10000000:3.0:1788864984.430657:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 580: rc = 0 00100000:10000000:3.0:1788864984.431153:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 580: rc = 0 00100000:10000000:3.0:1788864984.431524:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 308: rc = 0 00100000:10000000:3.0:1788864984.433103:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788864984.433287:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 560: rc = 0 00100000:10000000:3.0:1788864984.433488:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788864984.433561:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 560: rc = 0 00100000:10000000:3.0:1788864984.433985:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788864984.434173:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 560: rc = 0 00100000:10000000:3.0:1788864984.434534:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788864984.434600:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 645: rc = 0 00100000:10000000:3.0:1788864984.434949:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788864984.435093:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 645: rc = 0 00100000:10000000:3.0:1788864984.435285:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788864984.435354:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 645: rc = 0 00000020:00000080:3.0:1788864984.435613:0:14283:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788864984.435621:0:14283:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788864984.435630:0:14283:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf8c13e2d0e95a1aa 00000020:01000004:3.0:1788864984.435638:0:14283:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788864984.435643:0:14283:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788864984.435647:0:14283:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fdb812fc800 from MGS 00000020:01000004:3.0:1788864984.435651:0:14283:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788864984.435661:0:14283:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9fdc9099b380) 00000020:00000080:3.0:1788864984.435670:0:14283:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788864984.435866:0:14283:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fdb812fc800 from MGS, refs=2 00080000:01000000:3.0:1788864984.435871:0:14283:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788864984.435877:0:14283:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf8c13e2d0e95a1b8 00000100:00100000:3.0:1788864984.436091:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788864984.436212:0:14283:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788864984.436217:0:14283:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788864984.436697:0:14283:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788864984.436860:0:14283:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788864984.437567:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788864984.437874:0:14283:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788864984.437930:0:14283:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788864984.438392:0:14283:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788864984.438397:0:14283:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788864984.438696:0:14283:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788864984.438742:0:14283:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788864984.439361:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864984.439365:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864984.439367:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864984.439638:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864984.439641:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864984.439643:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864984.440495:0:14283:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788864984.445025:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788864984.454448:0:14283:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788864984.454466:0:14283:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788864984.454469:0:14283:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788864984.456646:0:14292:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788864984.456842:0:14283:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788864984.457125:0:14283:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788864984.457596:0:14283:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788864984.458210:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788864984.458386:0:14283:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788864984.458392:0:14283:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788864984.460740:0:14283:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788864984.460752:0:14283:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788864984.461403:0:14283:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788864984.461409:0:14283:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1788864984.465980:0:14297:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1788864984.466009:0:14283:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788864984.466028:0:14283:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.113@tcp' 00000020:01000004:2.0:1788864984.466030:0:14283:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788864984.466059:0:14283:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.113@tcp (typ=mgc) 00000020:00000080:2.0:1788864984.466073:0:14283:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.113@tcp (ffff9fdca5be19c0) 00000020:00000080:2.0:1788864984.466087:0:14283:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788864984.467442:0:14283:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fdcbc862800@MGC192.168.203.113@tcp: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1788864984.467645:0:14283:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.113@tcp-0 is initialized 00000040:01000000:2.0:1788864984.467652:0:14283:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788864984.468247:0:14298:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788864984.468332:0:14283:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.113@tcp (uuid f5c43d6a-bb58-4fb8-a6ee-705419d652e1) 00000020:00000080:2.0:1788864984.468351:0:14283:0:(genops.c:1384:class_connect()) connect: client f5c43d6a-bb58-4fb8-a6ee-705419d652e1, cookie 0xf8c13e2d0e95a1c6 00000100:00080000:2.0:1788864984.468361:0:14283:0:(import.c:545:import_select_connection()) MGC192.168.203.113@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788864984.468370:0:14283:0:(import.c:666:import_select_connection()) MGC192.168.203.113@tcp: import ffff9fdcbc862800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788864984.468412:0:14283:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fdcac9cce00 x1875760546662400/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788864984.468467:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3299:1875760546662400:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788864984.468539:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788864984.468594:0:14283:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f5c43d6a-bb58-4fb8-a6ee-705419d652e1->MGS 00000020:01000004:2.0:1788864984.468620:0:14283:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788864984.468625:0:14283:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788864984.468636:0:14283:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9fdca5be0000) 00000020:00000080:2.0:1788864984.468645:0:14283:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788864984.468758:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546662400 00000100:00100000:1.0:1788864984.468766:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546662400 00000100:00100000:1.0:1788864984.468807:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788864984.468815:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3299:x1875760546662400:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788864984.468838:0:14293:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from f5c43d6a-bb58-4fb8-a6ee-705419d652e1@0@lo t0 exp 0000000000000000 cur 407 last 0 00000020:00000080:1.0:1788864984.468860:0:14293:0:(genops.c:1384:class_connect()) connect: client f5c43d6a-bb58-4fb8-a6ee-705419d652e1, cookie 0xf8c13e2d0e95a1d4 00000100:00080000:1.0:1788864984.468978:0:14293:0:(import.c:65:import_set_state_nolock()) ffff9fdb82687000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788864984.473983:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+5:3299:x1875760546662400:12345-0@lo:250:mount.lustre.0 Request processed in 5158us (5434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864984.474062:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788864984.477814:0:3299:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.113@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788864984.477828:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.113@tcp: connect to target with instance 0 00000100:00080000:3.0:1788864984.477836:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.113@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788864984.477841:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788864984.477845:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fdcbc862800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788864984.477848:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788864984.477872:0:3299:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788864984.477879:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3299:1875760546662400:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788864984.478115:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788864984.478292:0:14283:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788864984.478298:0:14283:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788864984.480588:0:14283:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788864984.480688:0:14283:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788864984.483951:0:14283:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788864984.483961:0:14283:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788864984.487126:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788864984.487308:0:14283:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788864984.487314:0:14283:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788864984.489085:0:14283:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788864984.489101:0:14283:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788864984.520339:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788864984.520539:0:14283:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788864984.520545:0:14283:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788864984.521485:0:14283:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788864984.521494:0:14283:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788864984.525299:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788864984.525539:0:14283:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788864984.525546:0:14283:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788864984.525939:0:14283:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788864984.525945:0:14283:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788864984.526468:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788864984.526656:0:14283:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788864984.526662:0:14283:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788864984.527548:0:14283:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788864984.527557:0:14283:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788864984.528132:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788864984.528299:0:14283:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788864984.528304:0:14283:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788864984.528871:0:14283:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788864984.528882:0:14283:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788864984.542578:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788864984.542916:0:14283:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788864984.542922:0:14283:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788864984.544546:0:14283:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788864984.544556:0:14283:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788864984.545464:0:14283:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788864984.545472:0:14283:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788864984.548745:0:14283:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788864984.548778:0:14283:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788864984.548784:0:14283:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788864984.548911:0:14283:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788864984.548948:0:14283:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788864984.548952:0:14283:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788864984.548954:0:14283:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788864984.548956:0:14283:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788864984.548957:0:14283:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788864984.548960:0:14283:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788864984.548961:0:14283:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788864984.548963:0:14283:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788864984.548964:0:14283:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788864984.548966:0:14283:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788864984.548968:0:14283:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788864984.548970:0:14283:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788864984.548972:0:14283:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788864984.548974:0:14283:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788864984.548975:0:14283:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788864984.548976:0:14283:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788864984.548977:0:14283:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788864984.548978:0:14283:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788864984.548979:0:14283:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788864984.548981:0:14283:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788864984.548982:0:14283:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788864984.548982:0:14283:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788864984.549017:0:14283:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788864984.549037:0:14283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546662528:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788864984.549107:0:14283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864984.549160:0:14283:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc9f5170c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864984.549326:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546662528 00000100:00100000:0.0:1788864984.549334:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546662528 00000100:00100000:0.0:1788864984.549383:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788864984.549394:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+5:14283:x1875760546662528:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788864984.549441:0:14296:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788864984.549444:0:14296:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788864984.549448:0:14296:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788864984.550415:0:14317:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788864984.550765:0:14296:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788864984.552161:0:14318:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788864984.552167:0:14318:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788864984.552170:0:14318:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788864984.552841:0:14318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788864984.553140:0:14296:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788864984.553150:0:14296:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788864984.564759:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+5:14283:x1875760546662528:12345-0@lo:253:mount.lustre.0 Request processed in 15360us (15645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864984.564778:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788864984.564894:0:14283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546662528:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788864984.564907:0:14283:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788864984.564911:0:14283:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788864984.564912:0:14283:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788864984.564914:0:14283:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788864984.564915:0:14283:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788864984.564916:0:14283:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788864984.564918:0:14283:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788864984.564919:0:14283:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788864984.564920:0:14283:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788864984.564922:0:14283:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788864984.564923:0:14283:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788864984.564948:0:14283:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fdb812fc800 from lustre-MDT0000 10000000:01000000:3.0:1788864984.564970:0:14283:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788864984.564973:0:14283:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788864984.564977:0:14283:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9fdca5be19c0 10000000:01000000:3.0:1788864984.564981:0:14283:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788864984.564988:0:14283:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fdca5be19c0 from 1 10000000:01000000:3.0:1788864984.564991:0:14283:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788864984.565025:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044e00/0xf8c13e2d0e95a1db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.565036:0:14283:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044e00/0xf8c13e2d0e95a1db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.565045:0:14283:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044e00/0xf8c13e2d0e95a1db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864984.565064:0:14283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546662656:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788864984.565107:0:14283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864984.565142:0:14283:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca2e7d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788864984.565284:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546662656 00000100:00100000:2.0:1788864984.565291:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546662656 00000100:00100000:2.0:1788864984.565329:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788864984.565338:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+5:14283:x1875760546662656:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788864984.565348:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864984.565361:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcb5384200/0xf8c13e2d0e95a1e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95a1db expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864984.565391:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcb5384200/0xf8c13e2d0e95a1e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a1db expref: 6 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864984.565401:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcb5384200/0xf8c13e2d0e95a1e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a1db expref: 6 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864984.565410:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384200, rc 0) 00000100:00100000:2.0:1788864984.565443:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+6:14283:x1875760546662656:12345-0@lo:101:mount.lustre.0 Request processed in 106us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864984.565449:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788864984.565718:0:14283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546662656:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788864984.565732:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044e00/0xf8c13e2d0e95a1db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a1e2 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.565750:0:14283:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044e00/0xf8c13e2d0e95a1db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95a1e2 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864984.565793:0:14283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546662784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788864984.565816:0:14283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864984.565839:0:14283:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca2e7d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788864984.567193:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546662784 00000100:00100000:2.0:1788864984.567202:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546662784 00000100:00100000:2.0:1788864984.567248:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788864984.567256:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+6:14283:x1875760546662784:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788864984.567519:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+6:14283:x1875760546662784:12345-0@lo:501:mount.lustre.0 Request processed in 262us (1701us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788864984.567527:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788864984.567735:0:14283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546662784:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788864984.567773:0:14283:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788864984.567791:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044e00/0xf8c13e2d0e95a1db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a1e2 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864984.567802:0:14283:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044e00/0xf8c13e2d0e95a1db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a1e2 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864984.567821:0:14283:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fdb812fc800 10000000:01000000:0.0:1788864984.567826:0:14283:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788864984.567830:0:14283:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fdb812fc800 10000000:01000000:0.0:1788864984.567833:0:14283:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788864984.567836:0:14283:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fdb812fc800 from 1 10000000:01000000:0.0:1788864984.567839:0:14283:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788864984.567865:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4b200/0xf8c13e2d0e95a1e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864984.567872:0:14283:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4b200/0xf8c13e2d0e95a1e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864984.567890:0:14283:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4b200/0xf8c13e2d0e95a1e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864984.567909:0:14283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546662912:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788864984.570020:0:14283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864984.570068:0:14283:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfdfbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788864984.570188:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546662912 00000100:00100000:3.0:1788864984.570197:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546662912 00000100:00100000:3.0:1788864984.570258:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788864984.570266:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+6:14283:x1875760546662912:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788864984.570281:0:14293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864984.570300:0:14293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcc2044400/0xf8c13e2d0e95a1f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95a1e9 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.570325:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcc2044400/0xf8c13e2d0e95a1f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a1e9 expref: 7 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.570336:0:14293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcc2044400/0xf8c13e2d0e95a1f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a1e9 expref: 7 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.570344:0:14293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcc2044400, rc 0) 00000100:00100000:3.0:1788864984.570399:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+7:14283:x1875760546662912:12345-0@lo:101:mount.lustre.0 Request processed in 133us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864984.570416:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788864984.570538:0:14283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546662912:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788864984.570554:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4b200/0xf8c13e2d0e95a1e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a1f0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864984.570564:0:14283:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4b200/0xf8c13e2d0e95a1e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95a1f0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788864984.570580:0:14283:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788864984.570596:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4b200/0xf8c13e2d0e95a1e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a1f0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864984.570604:0:14283:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4b200/0xf8c13e2d0e95a1e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a1f0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788864984.570612:0:14283:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788864984.570617:0:14283:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788864984.570622:0:14283:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fdb812fc800 10000000:01000000:1.0:1788864984.570624:0:14283:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788864984.570628:0:14283:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788864984.570631:0:14283:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788864984.570655:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75a00/0xf8c13e2d0e95a1f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864984.570663:0:14283:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75a00/0xf8c13e2d0e95a1f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864984.570671:0:14283:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75a00/0xf8c13e2d0e95a1f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864984.570687:0:14283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81927100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546663040:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788864984.570755:0:14283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864984.570767:0:14283:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca0280a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788864984.570826:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546663040 00000100:00100000:0.0:1788864984.570830:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546663040 00000100:00100000:0.0:1788864984.570862:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788864984.570869:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+7:14283:x1875760546663040:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788864984.570876:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864984.570895:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdca2d4b400/0xf8c13e2d0e95a1fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95a1f7 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864984.570908:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdca2d4b400/0xf8c13e2d0e95a1fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a1f7 expref: 8 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864984.570929:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdca2d4b400/0xf8c13e2d0e95a1fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a1f7 expref: 8 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864984.570935:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4b400, rc 0) 00000100:00100000:0.0:1788864984.570962:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+8:14283:x1875760546663040:12345-0@lo:101:mount.lustre.0 Request processed in 94us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864984.570968:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788864984.571089:0:14283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81927100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546663040:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788864984.571099:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75a00/0xf8c13e2d0e95a1f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a1fe expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864984.571107:0:14283:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75a00/0xf8c13e2d0e95a1f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95a1fe expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864984.571151:0:14283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81927100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546663168:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788864984.571175:0:14283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864984.571210:0:14283:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca0280a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788864984.571333:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546663168 00000100:00100000:3.0:1788864984.571339:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546663168 00000100:00100000:3.0:1788864984.571357:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788864984.571362:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+8:14283:x1875760546663168:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788864984.572004:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+9:14283:x1875760546663168:12345-0@lo:501:mount.lustre.0 Request processed in 639us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864984.572012:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788864984.572115:0:14283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81927100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546663168:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788864984.572148:0:14283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81927100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546663296:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788864984.572186:0:14283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864984.572224:0:14283:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca0280a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788864984.572566:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546663296 00000100:00100000:3.0:1788864984.572571:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546663296 00000100:00100000:3.0:1788864984.572638:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788864984.572647:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+9:14283:x1875760546663296:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788864984.572955:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+9:14283:x1875760546663296:12345-0@lo:503:mount.lustre.0 Request processed in 308us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864984.572962:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788864984.573036:0:14283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81927100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546663296:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788864984.574061:0:14319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81927100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14319:1875760546663424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788864984.574113:0:14319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864984.574430:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546663424 00000100:00100000:0.0:1788864984.574436:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546663424 00000100:00100000:2.0:1788864984.574474:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788864984.574484:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+9:14319:x1875760546663424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788864984.574751:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+9:14319:x1875760546663424:12345-0@lo:502:llog_process_th.0 Request processed in 268us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864984.574758:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788864984.574802:0:14319:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca0280180 going to sleep for 11 seconds 00000100:00100000:2.0:1788864984.574819:0:14319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81927100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14319:1875760546663424:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788864984.574843:0:14319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788864984.574853:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864984.574855:0:14319:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788864984.574861:0:14319:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788864984.574864:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788864984.574886:0:14319:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9fdca5be4d40) 00000020:00000080:2.0:1788864984.574900:0:14319:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788864984.574905:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788864984.574971:0:14319:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788864984.574978:0:14319:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf8c13e2d0e95a20c 00000020:00000080:2.0:1788864984.575171:0:14319:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788864984.575176:0:14319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864984.575180:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864984.575181:0:14319:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788864984.575184:0:14319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788864984.575187:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864984.575188:0:14319:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788864984.575191:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788864984.575197:0:14319:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9fdca5be3380) 00000020:00000080:2.0:1788864984.575206:0:14319:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788864984.575210:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788864984.575212:0:14319:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788864984.575214:0:14319:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788864984.575226:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788864984.575273:0:14319:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fdb812fc800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788864984.575286:0:14319:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9fdca1ff4d40) 00000020:00000080:2.0:1788864984.575294:0:14319:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788864984.575342:0:14319:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788864984.575352:0:14319:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf8c13e2d0e95a221 00000020:00000080:2.0:1788864984.575453:0:14319:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788864984.575459:0:14319:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788864984.575464:0:14319:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf8c13e2d0e95a228 00080000:01000000:2.0:1788864984.575468:0:14319:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788864984.575471:0:14319:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf8c13e2d0e95a22f 00010000:00010000:1.0:1788864984.670574:0:14319:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788864984.671138:0:14319:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1788864984.671400:0:14319:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788864984.672084:0:14319:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9fdc9f648000) 00000020:00000080:1.0:1788864984.672106:0:14319:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788864984.672174:0:14319:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788864984.672187:0:14319:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf8c13e2d0e95a23d 00000020:00000080:3.0:1788864984.674787:0:14319:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788864984.678305:0:14319:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf8c13e2d0e95a244 00000020:00000080:0.0:1788864984.681096:0:14319:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788864984.681108:0:14319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788864984.681115:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864984.681118:0:14319:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788864984.681121:0:14319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788864984.681124:0:14319:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1788864984.681125:0:14319:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788864984.681127:0:14319:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788864984.681128:0:14319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788864984.681130:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864984.681132:0:14319:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788864984.681134:0:14319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788864984.681138:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864984.681140:0:14319:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788864984.681145:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788864984.681187:0:14319:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788864984.681210:0:14319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788864984.681214:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864984.681215:0:14319:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788864984.681218:0:14319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788864984.681221:0:14319:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788864984.681229:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864984.681231:0:14319:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788864984.681234:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788864984.681239:0:14319:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:0.0:1788864984.681263:0:14319:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788864984.681266:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788864984.681280:0:14319:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9fdca14ccd40) 00000020:00000080:0.0:1788864984.681296:0:14319:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788864984.681301:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788864984.681353:0:14319:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788864984.681358:0:14319:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788864984.681364:0:14319:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf8c13e2d0e95a252 00010000:00080000:0.0:1788864984.681404:0:14319:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fdc837a9800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:0.0:1788864984.681614:0:14319:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788864984.688359:0:14319:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788864984.688443:0:14319:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788864984.695531:0:14319:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788864984.695597:0:14319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788864984.695679:0:14319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788864984.699457:0:14323:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788864984.699463:0:14323:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788864984.700324:0:14319:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788864984.700338:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788864984.700367:0:14319:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788864984.700395:0:14319:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf8c13e2d0e95a259 00000100:00080000:2.0:1788864984.700405:0:14319:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788864984.700417:0:14319:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fdc837a9800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788864984.700460:0:14319:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fdcac9cf800 x1875760546663552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788864984.700533:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875760546663552:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788864984.700588:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875760546663552 offset 0 length 520: 4 00000100:00080000:2.0:1788864984.701366:0:14319:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788864984.701445:0:14319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864984.701450:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864984.701452:0:14319:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788864984.701455:0:14319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788864984.701458:0:14319:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788864984.701460:0:14319:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788864984.701461:0:14319:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788864984.701468:0:14319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788864984.701471:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864984.701473:0:14319:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788864984.701475:0:14319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788864984.701479:0:14319:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788864984.701483:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864984.701484:0:14319:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788864984.701487:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788864984.701491:0:14319:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:2.0:1788864984.701511:0:14319:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788864984.701513:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788864984.701524:0:14319:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9fdca1ff0000) 00000020:00000080:2.0:1788864984.701538:0:14319:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788864984.701542:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788864984.701596:0:14319:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788864984.701602:0:14319:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788864984.701606:0:14319:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf8c13e2d0e95a267 00010000:00080000:2.0:1788864984.701633:0:14319:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fdc83524000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1788864984.701903:0:14319:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788864984.702338:0:14319:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788864984.702360:0:14319:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788864984.703679:0:14319:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788864984.703776:0:14319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788864984.703861:0:14319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788864984.708870:0:14325:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788864984.708886:0:14325:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788864984.710119:0:14319:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788864984.710133:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788864984.710166:0:14319:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788864984.710184:0:14319:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf8c13e2d0e95a26e 00000100:00080000:3.0:1788864984.710193:0:14319:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788864984.710271:0:14319:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fdc83524000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788864984.710304:0:14319:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fdc86eb8a80 x1875760546663680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788864984.710337:0:14319:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788864984.710419:0:14319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788864984.710424:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864984.710426:0:14319:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788864984.710429:0:14319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788864984.710432:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864984.710434:0:14319:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788864984.710437:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788864984.710439:0:14319:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788864984.710441:0:14319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788864984.710443:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864984.710445:0:14319:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788864984.710447:0:14319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788864984.710449:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864984.710450:0:14319:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788864984.710453:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788864984.710479:0:14319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14319:1875760546663808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788864984.710549:0:14319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864984.710579:0:14319:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca2e7d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788864984.711342:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546663808 00000100:00100000:0.0:1788864984.711350:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546663808 00000100:00100000:0.0:1788864984.711399:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788864984.711408:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+9:14319:x1875760546663808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864984.711675:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+9:14319:x1875760546663808:12345-0@lo:502:llog_process_th.0 Request processed in 268us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864984.711683:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788864984.711750:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875760546663680:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788864984.711775:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875760546663680 offset 0 length 520: 4 00000100:00100000:2.0:1788864984.721241:0:14319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14319:1875760546663808:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788864984.722783:0:14319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788864984.722799:0:14319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864984.722801:0:14319:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788864984.722808:0:14319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788864984.723032:0:14283:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788864984.723051:0:14283:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788864984.723071:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75a00/0xf8c13e2d0e95a1f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a1fe expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864984.723084:0:14283:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75a00/0xf8c13e2d0e95a1f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a1fe expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864984.723105:0:14283:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fdb812fc800 from 1 10000000:01000000:2.0:1788864984.723108:0:14283:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788864984.723146:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385000/0xf8c13e2d0e95a275 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864984.723154:0:14283:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385000/0xf8c13e2d0e95a275 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864984.723165:0:14283:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385000/0xf8c13e2d0e95a275 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864984.723188:0:14283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546663936:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788864984.723317:0:14283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864984.723356:0:14283:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca0d35180 going to sleep for 11 seconds 00000100:00100000:3.0:1788864984.723459:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546663936 00000100:00100000:3.0:1788864984.723467:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546663936 00000100:00100000:3.0:1788864984.723516:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788864984.723524:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+9:14283:x1875760546663936:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788864984.723535:0:14293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864984.723548:0:14293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcc2044200/0xf8c13e2d0e95a27c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95a275 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.723580:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcc2044200/0xf8c13e2d0e95a27c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a275 expref: 10 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.723589:0:14293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcc2044200/0xf8c13e2d0e95a27c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a275 expref: 10 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.723597:0:14293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcc2044200, rc 0) 00000100:00100000:3.0:1788864984.723631:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+10:14283:x1875760546663936:12345-0@lo:101:mount.lustre.0 Request processed in 109us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864984.723637:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788864984.723895:0:14283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546663936:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788864984.723909:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385000/0xf8c13e2d0e95a275 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a27c expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864984.723919:0:14283:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385000/0xf8c13e2d0e95a275 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95a27c expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864984.724660:0:14283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546664064:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788864984.724740:0:14283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864984.724770:0:14283:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca0d35180 going to sleep for 11 seconds 00000100:00100000:3.0:1788864984.725806:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546664064 00000100:00100000:3.0:1788864984.725815:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546664064 00000100:00100000:3.0:1788864984.725857:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788864984.725867:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+10:14283:x1875760546664064:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788864984.725893:0:14296:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788864984.725900:0:14296:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788864984.726137:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+10:14283:x1875760546664064:12345-0@lo:256:mount.lustre.0 Request processed in 271us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864984.726145:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788864984.726364:0:14283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546664064:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788864984.728557:0:14283:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788864984.729320:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385000/0xf8c13e2d0e95a275 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a27c expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864984.729334:0:14283:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385000/0xf8c13e2d0e95a275 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a27c expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864984.731341:0:14283:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fdb812fc800 from 1 10000000:01000000:3.0:1788864984.731349:0:14283:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788864984.731402:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045000/0xf8c13e2d0e95a283 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.731414:0:14283:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045000/0xf8c13e2d0e95a283 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.731426:0:14283:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045000/0xf8c13e2d0e95a283 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864984.731458:0:14283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86ebb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546664192:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788864984.731518:0:14283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864984.731558:0:14283:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca2c01a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788864984.731656:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546664192 00000100:00100000:2.0:1788864984.731664:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546664192 00000100:00100000:2.0:1788864984.731903:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788864984.731912:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+10:14283:x1875760546664192:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788864984.731933:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864984.731948:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcb5385c00/0xf8c13e2d0e95a28a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95a283 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864984.731972:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcb5385c00/0xf8c13e2d0e95a28a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a283 expref: 11 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864984.731982:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcb5385c00/0xf8c13e2d0e95a28a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a283 expref: 11 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864984.731991:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385c00, rc 0) 00000100:00100000:2.0:1788864984.732038:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+11:14283:x1875760546664192:12345-0@lo:101:mount.lustre.0 Request processed in 128us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864984.732045:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788864984.732163:0:14283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86ebb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546664192:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788864984.732178:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045000/0xf8c13e2d0e95a283 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a28a expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864984.732187:0:14283:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045000/0xf8c13e2d0e95a283 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95a28a expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864984.732259:0:14283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81926d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546664320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788864984.732284:0:14283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864984.732311:0:14283:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcacaa7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788864984.732469:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546664320 00000100:00100000:2.0:1788864984.732475:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546664320 00000100:00100000:2.0:1788864984.732505:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788864984.732511:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+11:14283:x1875760546664320:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788864984.732891:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+11:14283:x1875760546664320:12345-0@lo:501:mount.lustre.0 Request processed in 379us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864984.732904:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788864984.733027:0:14283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81926d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546664320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788864984.733058:0:14283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81926d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546664448:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788864984.733097:0:14283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864984.733112:0:14283:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcacaa7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788864984.733825:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546664448 00000100:00100000:2.0:1788864984.733832:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546664448 00000100:00100000:2.0:1788864984.733909:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788864984.733917:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+11:14283:x1875760546664448:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788864984.734089:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+11:14283:x1875760546664448:12345-0@lo:503:mount.lustre.0 Request processed in 172us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864984.734096:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788864984.735277:0:14283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81926d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546664448:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788864984.735751:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81926d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14327:1875760546664576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788864984.735808:0:14327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864984.735836:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcacaa7000 going to sleep for 11 seconds 00000100:00100000:2.0:1788864984.736003:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546664576 00000100:00100000:2.0:1788864984.736009:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546664576 00000100:00100000:2.0:1788864984.736039:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788864984.736046:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+11:14327:x1875760546664576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788864984.736442:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+11:14327:x1875760546664576:12345-0@lo:502:llog_process_th.0 Request processed in 395us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864984.736450:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788864984.736778:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81926d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14327:1875760546664576:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788864984.736807:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788864984.736817:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864984.736819:0:14327:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788864984.736827:0:14327:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fdb812fc800 00000020:00000080:1.0:1788864984.736835:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788864984.736844:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788864984.736846:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864984.736847:0:14327:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788864984.736850:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788864984.736852:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864984.736853:0:14327:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788864984.736856:0:14327:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fdb812fc800 00000020:00000080:1.0:1788864984.736858:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788864984.737117:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788864984.737121:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864984.737123:0:14327:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788864984.737125:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788864984.737128:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864984.737129:0:14327:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788864984.737133:0:14327:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fdb812fc800 00000020:00000080:1.0:1788864984.737135:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788864984.741026:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81926d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14327:1875760546664704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788864984.741104:0:14327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864984.741147:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc84eaa300 going to sleep for 11 seconds 00000100:00100000:1.0:1788864984.741768:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546664704 00000100:00100000:1.0:1788864984.741776:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546664704 00000100:00100000:1.0:1788864984.741820:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788864984.741828:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+11:14327:x1875760546664704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788864984.742062:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+11:14327:x1875760546664704:12345-0@lo:502:llog_process_th.0 Request processed in 233us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864984.742069:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788864984.742125:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81926d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14327:1875760546664704:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788864984.742153:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788864984.742161:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864984.742168:0:14327:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788864984.742172:0:14327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788864984.742463:0:14283:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788864984.742481:0:14283:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788864984.742567:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045000/0xf8c13e2d0e95a283 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a28a expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864984.742584:0:14283:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045000/0xf8c13e2d0e95a283 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a28a expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864984.742624:0:14283:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788864984.742627:0:14283:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fdb812fc800 10000000:01000000:0.0:1788864984.742629:0:14283:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fdb812fc800 10000000:01000000:0.0:1788864984.742633:0:14283:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788864984.742639:0:14283:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fdb812fc800 from 1 10000000:01000000:0.0:1788864984.742641:0:14283:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788864984.742665:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4ae00/0xf8c13e2d0e95a291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864984.742673:0:14283:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4ae00/0xf8c13e2d0e95a291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864984.742682:0:14283:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4ae00/0xf8c13e2d0e95a291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864984.742697:0:14283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546664832:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788864984.742748:0:14283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864984.750085:0:14283:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfdfb240 going to sleep for 11 seconds 00000100:00100000:2.0:1788864984.750325:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546664832 00000100:00100000:2.0:1788864984.750334:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546664832 00000100:00100000:2.0:1788864984.750393:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788864984.750401:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+11:14283:x1875760546664832:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788864984.750416:0:14293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864984.750433:0:14293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcb5384800/0xf8c13e2d0e95a298 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95a291 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864984.750458:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcb5384800/0xf8c13e2d0e95a298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a291 expref: 12 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864984.750467:0:14293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcb5384800/0xf8c13e2d0e95a298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a291 expref: 12 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864984.751958:0:14293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384800, rc 0) 00000100:00100000:2.0:1788864984.752098:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:14283:x1875760546664832:12345-0@lo:101:mount.lustre.0 Request processed in 1695us (9347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864984.752107:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788864984.757418:0:14283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546664832:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788864984.757512:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4ae00/0xf8c13e2d0e95a291 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a298 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864984.757526:0:14283:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4ae00/0xf8c13e2d0e95a291 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95a298 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864984.757608:0:14283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81926d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546664960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788864984.757672:0:14283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864984.757740:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546664960 00000100:00100000:1.0:1788864984.757747:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546664960 00000100:00100000:1.0:1788864984.757949:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788864984.757959:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:14283:x1875760546664960:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788864984.758293:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:14283:x1875760546664960:12345-0@lo:501:mount.lustre.0 Request processed in 335us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864984.758302:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788864984.758532:0:14283:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc86efd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864984.758550:0:14283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81926d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546664960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788864984.758587:0:14283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81926d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546665088:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788864984.758625:0:14283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864984.758652:0:14283:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc86efd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864984.759056:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546665088 00000100:00100000:2.0:1788864984.759063:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546665088 00000100:00100000:2.0:1788864984.759097:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788864984.759105:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:14283:x1875760546665088:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788864984.759276:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:14283:x1875760546665088:12345-0@lo:503:mount.lustre.0 Request processed in 172us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864984.759284:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788864984.759514:0:14283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81926d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546665088:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788864984.771506:0:14332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81926d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14332:1875760546665216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788864984.771593:0:14332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864984.773136:0:14332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc86efd300 going to sleep for 11 seconds 00000100:00100000:2.0:1788864984.782455:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546665216 00000100:00100000:2.0:1788864984.782469:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546665216 00000100:00100000:2.0:1788864984.782524:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788864984.782533:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:14332:x1875760546665216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788864984.782843:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:14332:x1875760546665216:12345-0@lo:502:llog_process_th.0 Request processed in 310us (11249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864984.782851:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788864984.783064:0:14332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81926d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14332:1875760546665216:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788864984.783130:0:14332:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788864984.783143:0:14332:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9fdc9f64cd40) 00000020:00000080:1.0:1788864984.783162:0:14332:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1788864984.783307:0:14332:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fdb812fc800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788864984.783312:0:14332:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fdb812fc800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788864984.783315:0:14332:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fdb812fc800 4 00010000:00080000:1.0:1788864984.783341:0:14332:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fdcbfd94800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:0.0:1788864984.786566:0:14332:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788864984.786808:0:14332:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788864984.786844:0:14332:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788864984.786855:0:14332:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf8c13e2d0e95a2a6 00000100:00080000:0.0:1788864984.786864:0:14332:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788864984.786874:0:14332:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fdcbfd94800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1788864984.786917:0:14332:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fdc9f45e680 x1875760546665344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788864984.786958:0:14332:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788864984.787407:0:14332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14332:1875760546665472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864984.787477:0:14332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864984.787512:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546665472 00000100:00100000:0.0:1788864984.787518:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546665472 00000100:00100000:0.0:1788864984.787549:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788864984.787558:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:14332:x1875760546665472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864984.787804:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:14332:x1875760546665472:12345-0@lo:502:llog_process_th.0 Request processed in 247us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864984.787812:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788864984.787856:0:14332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbfdfb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864984.787874:0:14332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14332:1875760546665472:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788864984.788147:0:14332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:3.0:1788864984.788642:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875760546665344:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788864984.788689:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864984.788781:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546665344 00000100:00100000:3.0:1788864984.788787:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546665344 00000100:00100000:3.0:1788864984.788810:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788864984.788816:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875760546665344:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788864984.788860:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875760546665344:12345-0@lo:38:llog_process_th.0 Request processed in 42us (170us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788864984.788866:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788864984.789025:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788864984.789031:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fdcbfd94800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788864984.789035:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788864984.789038:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875760546665344:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788864984.789102:0:14283:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788864984.789125:0:14283:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788864984.789148:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4ae00/0xf8c13e2d0e95a291 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a298 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864984.789158:0:14283:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4ae00/0xf8c13e2d0e95a291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a298 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788864984.789282:0:14283:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788864984.789284:0:14283:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788864984.789286:0:14283:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788864984.789287:0:14283:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788864984.789289:0:14283:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788864984.789290:0:14283:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788864984.789291:0:14283:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788864984.789293:0:14283:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788864984.789294:0:14283:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788864984.789296:0:14283:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788864984.789299:0:14283:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788864984.789301:0:14283:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788864984.789303:0:14283:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788864984.789304:0:14283:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788864984.789305:0:14283:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788864984.789306:0:14283:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788864984.789307:0:14283:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788864984.789308:0:14283:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788864984.789309:0:14283:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788864984.789310:0:14283:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788864984.789311:0:14283:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788864984.789329:0:14283:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788864984.789341:0:14283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546665600:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788864984.789395:0:14283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864984.789422:0:14283:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc82e0c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788864984.789545:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546665600 00000100:00100000:0.0:1788864984.789549:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546665600 00000100:00100000:0.0:1788864984.789584:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788864984.789591:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:14283:x1875760546665600:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788864984.789668:0:14295:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788864984.789680:0:14295:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788864984.851409:0:14295:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788864984.851420:0:14295:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788864984.851900:0:14317:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788864984.851905:0:14317:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788864984.851924:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e95a2ad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.851952:0:14317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdcc2044200/0xf8c13e2d0e95a27c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a275 expref: 12 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.851961:0:14317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e95a2ad lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.852013:0:14317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdcc2044200/0xf8c13e2d0e95a27c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e95a275 expref: 12 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.852026:0:14317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fdcc2044200/0xf8c13e2d0e95a27c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a275 expref: 12 pid: 14293 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864984.852041:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14317:1875760546665728:0@lo:104: 00000100:00100000:3.0:1788864984.852099:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864984.852146:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca2c01e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788864984.852237:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546665728 00000100:00100000:2.0:1788864984.852245:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546665728 00000100:00100000:2.0:1788864984.852324:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788864984.852334:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+3:14317:x1875760546665728:12345-0@lo:104: 00010000:00010000:2.0:1788864984.852346:0:14284:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385000/0xf8c13e2d0e95a275 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e95a27c expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864984.852405:0:14284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788864984.852421:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+3:14317:x1875760546665728:12345-0@lo:104: Request processed in 89us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864984.852428:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788864984.852465:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14317:1875760546665728:0@lo:104: 00010000:00010000:2.0:1788864984.852482:0:14317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e95a2ad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.852533:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788864984.852539:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385000/0xf8c13e2d0e95a275 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e95a27c expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.852546:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385000 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:3.0:1788864984.852550:0:14290:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385000/0xf8c13e2d0e95a275 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e95a27c expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.852559:0:14290:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385000/0xf8c13e2d0e95a275 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e95a27c expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788864984.852566:0:14290:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385000/0xf8c13e2d0e95a275 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e95a27c expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864984.852571:0:14290:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788864984.852598:0:14290:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385000/0xf8c13e2d0e95a275 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95a27c expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.852604:0:14290:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788864984.852631:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385000/0xf8c13e2d0e95a275 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95a27c expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.852643:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385000/0xf8c13e2d0e95a275 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95a27c expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.852658:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864984.852660:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864984.852661:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864984.852686:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788864984.852695:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3302:1875760546665856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788864984.852740:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864984.852795:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546665856 00000100:00100000:3.0:1788864984.852799:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546665856 00010000:00010000:3.0:1788864984.852816:0:14286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdcc2044200/0xf8c13e2d0e95a27c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a275 expref: 13 pid: 14293 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864984.852836:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788864984.852843:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+13:3302:x1875760546665856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788864984.852852:0:14286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864984.852857:0:14286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdcc2044200/0xf8c13e2d0e95a27c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a275 expref: 13 pid: 14293 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.852868:0:14286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdcc2044200/0xf8c13e2d0e95a27c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a275 expref: 13 pid: 14293 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.852886:0:14286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcc2044200/0xf8c13e2d0e95a27c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e95a275 expref: 13 pid: 14293 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.852897:0:14286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e95a2ad lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.852914:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e95a2ad lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788864984.852936:0:14286:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001031259s 00010000:00010000:3.0:1788864984.852941:0:14286:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e95a2ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.852948:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e95a2ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.852955:0:14286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e95a2ad lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.852961:0:14286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e95a2ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.852966:0:14286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc2044600 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:3.0:1788864984.852971:0:14286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e95a2ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.852978:0:14286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e95a2ad lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.853583:0:14286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e95a2ad lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.853597:0:14286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788864984.853634:0:14317:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e95a2ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.853642:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e95a2ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864984.853654:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e95a2ad lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864984.853720:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:3302:x1875760546665856:12345-0@lo:103:ldlm_bl.0 Request processed in 860us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864984.853728:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788864984.853763:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3302:1875760546665856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788864984.858511:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+11:14283:x1875760546665600:12345-0@lo:253:mount.lustre.0 Request processed in 68911us (69107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864984.858527:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788864984.858547:0:14283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14283:1875760546665600:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788864984.858563:0:14283:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788864984.858567:0:14283:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788864984.858569:0:14283:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788864984.858570:0:14283:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788864984.858572:0:14283:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788864984.858573:0:14283:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788864984.858574:0:14283:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788864984.858576:0:14283:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788864984.858577:0:14283:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788864984.858579:0:14283:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788864984.858580:0:14283:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788864984.858593:0:14283:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788864984.863827:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788864984.863986:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788864984.864257:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788864984.864981:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788864984.865566:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788864984.865932:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788864984.867335:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788864984.867510:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788864984.867819:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788864984.869045:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788864984.869330:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788864984.869494:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788864984.906292:0:14283:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788864984.907243:0:14283:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788864984.907258:0:14339:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788864984.907262:0:14339:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1788864984.909355:0:14340:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1788864984.909468:0:14340:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788864984.911274:0:14283:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788864984.911404:0:14283:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788864984.911976:0:14283:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788864984.911984:0:14283:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788864984.912101:0:14283:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788864984.915252:0:14283:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788864984.915944:0:14283:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:00080000:0.0:1788864984.915949:0:14340:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000040:01000000:3.0:1788864984.915978:0:14283:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000004:00080000:0.0:1788864984.915997:0:14340:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788864984.916002:0:14340:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1788864984.917336:0:14283:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:3.0:1788864984.918292:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1788864984.924587:0:14283:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788864984.976424:0:14283:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788864984.976459:0:14283:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd8c81973988 00100000:10000000:3.0:1788864984.976466:0:14283:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788864984.979209:0:14283:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788864984.979225:0:14283:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788864984.979236:0:14283:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788864984.979251:0:14283:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788864985.476828:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788864985.799134:0:14333:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788864985.799143:0:14333:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788864985.799555:0:14333:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788864985.799563:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:3.0:1788864985.862459:0:14298:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788864985.862467:0:14298:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fdb812fc800 from 6 10000000:01000000:3.0:1788864985.862471:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788864985.862517:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95a2b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864985.862530:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95a2b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864985.862541:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95a2b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864985.862584:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546665984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788864985.862653:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864985.862724:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca0dad6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864985.862783:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546665984 00000100:00100000:0.0:1788864985.862793:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546665984 00000100:00100000:0.0:1788864985.862855:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788864985.862882:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+11:14298:x1875760546665984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788864985.862896:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864985.862912:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdca2d4b000/0xf8c13e2d0e95a2bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95a2b4 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864985.862937:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdca2d4b000/0xf8c13e2d0e95a2bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a2b4 expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864985.862949:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdca2d4b000/0xf8c13e2d0e95a2bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a2b4 expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864985.862959:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4b000, rc 0) 00000100:00100000:0.0:1788864985.863048:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:14298:x1875760546665984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864985.863054:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788864985.863191:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546665984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788864985.863205:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95a2b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a2bb expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864985.863214:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95a2b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95a2bb expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864985.863270:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546666112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788864985.863300:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864985.863329:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca0dad6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864985.864533:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546666112 00000100:00100000:2.0:1788864985.864544:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546666112 00000100:00100000:2.0:1788864985.864588:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788864985.864596:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:14298:x1875760546666112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788864985.864625:0:14295:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788864985.864645:0:14295:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788864985.864649:0:14295:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788864985.864828:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:14298:x1875760546666112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 232us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864985.864836:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788864985.864884:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546666112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788864985.864933:0:14298:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788864985.864942:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95a2b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a2bb expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864985.864961:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95a2b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a2bb expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864986.500829:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788864986.822794:0:14333:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788864986.822803:0:14333:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788864986.823374:0:14333:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1788864986.823436:0:14333:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788864986.823470:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:1.0:1788864987.524898:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864988.548812:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864989.572965:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788864989.581669:0:14582:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1788864990.021540:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788864990.021547:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788864990.021550:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788864990.021553:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788864990.021555:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788864990.021558:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788864990.021562:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fdcbfd94800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788864990.021577:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fdcbfd94800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1788864990.021613:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fdb81925f80 x1875760546666368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788864990.021645:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875760546666368:0@lo:38:kworker.0 00000100:00100000:1.0:1788864990.021730:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864990.021957:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3300:1875760546666240:0@lo:400:kworker.0 00000100:00100000:2.0:1788864990.021990:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864990.022140:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546666240 00000100:00100000:1.0:1788864990.022148:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546666240 00000100:00100000:1.0:1788864990.022194:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788864990.022209:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:3300:x1875760546666240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864990.022256:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:3300:x1875760546666240:12345-0@lo:400:kworker.0 Request processed in 48us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864990.022263:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788864990.022319:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3300:1875760546666240:0@lo:400:kworker.0 00000100:00100000:0.0:1788864990.022976:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546666368 00000100:00100000:0.0:1788864990.022981:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546666368 00000100:00100000:0.0:1788864990.023005:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788864990.023011:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1875760546666368:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788864990.023031:0:14303:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 413 last 0 00000020:00000080:0.0:1788864990.023064:0:14303:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf8c13e2d0e95a2c2 00000004:00100000:0.0:1788864990.023076:0:14303:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788864990.023183:0:14303:0:(import.c:65:import_set_state_nolock()) ffff9fdcbba73800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788864990.023507:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875760546666368:12345-0@lo:38:kworker.0 Request processed in 494us (1776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864990.023523:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788864990.024107:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fdb81925f80 x1875760546666368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788865000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788864990.024123:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788864990.024132:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788864990.024137:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788864990.024140:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fdcbfd94800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788864990.024154:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875760546666368:0@lo:38:kworker.0 00010000:00010000:3.0:1788864990.600170:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864991.620877:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864992.644839:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788864992.718494:0:14734:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe5dfe0b80 20000000:00000080:3.0:1788864992.718513:0:14734:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fdcad10ec00 uarg=0000000000000000 20000000:01000000:3.0:1788864992.718548:0:14734:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788864992.718555:0:14734:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788864992.718559:0:14734:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788864992.719933:0:14735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788864992.720033:0:14734:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788864992.729444:0:14734:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788864992.729474:0:14734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fdcc2045800/0xf8c13e2d0e95a2c9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864992.729494:0:14734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdcb5385c00/0xf8c13e2d0e95a28a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a283 expref: 11 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864992.729503:0:14734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fdcc2045800/0xf8c13e2d0e95a2c9 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864992.729548:0:14734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdcb5385c00/0xf8c13e2d0e95a28a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e95a283 expref: 11 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864992.729565:0:14734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fdcb5385c00/0xf8c13e2d0e95a28a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a283 expref: 11 pid: 14295 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864992.729579:0:14734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86ebb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14734:1875760546666496:0@lo:104: 00000100:00100000:3.0:1788864992.729641:0:14734:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864992.729694:0:14734:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcbc4fff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788864992.729907:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546666496 00000100:00100000:2.0:1788864992.729916:0:14285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546666496 00000100:00100000:2.0:1788864992.730346:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788864992.730358:0:14285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+3:14734:x1875760546666496:12345-0@lo:104: 00010000:00010000:2.0:1788864992.730372:0:14285:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045000/0xf8c13e2d0e95a283 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e95a28a expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864992.730431:0:14285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788864992.730437:0:14285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+3:14734:x1875760546666496:12345-0@lo:104: Request processed in 83us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864992.730445:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788864992.730484:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864992.730490:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045000/0xf8c13e2d0e95a283 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e95a28a expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864992.730497:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc2045000 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:0.0:1788864992.730501:0:14289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045000/0xf8c13e2d0e95a283 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e95a28a expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864992.730510:0:14289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045000/0xf8c13e2d0e95a283 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e95a28a expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788864992.730517:0:14289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045000/0xf8c13e2d0e95a283 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e95a28a expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864992.730523:0:14289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788864992.730556:0:14289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045000/0xf8c13e2d0e95a283 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95a28a expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864992.730694:0:14289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788864992.730734:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045000/0xf8c13e2d0e95a283 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95a28a expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864992.730831:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045000/0xf8c13e2d0e95a283 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95a28a expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864992.730853:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864992.730855:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864992.730857:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864992.730890:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3301:1875760546666624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788864992.730924:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864992.731124:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546666624 00000100:00100000:2.0:1788864992.731129:0:14287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546666624 00010000:00010000:2.0:1788864992.731149:0:14287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdcb5385c00/0xf8c13e2d0e95a28a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a283 expref: 12 pid: 14295 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864992.731186:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788864992.731194:0:14287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:3301:x1875760546666624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788864992.731204:0:14287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864992.731219:0:14287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdcb5385c00/0xf8c13e2d0e95a28a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a283 expref: 12 pid: 14295 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864992.731237:0:14287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdcb5385c00/0xf8c13e2d0e95a28a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a283 expref: 12 pid: 14295 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864992.731253:0:14287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fdcc2045800/0xf8c13e2d0e95a2c9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864992.731260:0:14287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcc2045800/0xf8c13e2d0e95a2c9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864992.731274:0:14287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fdcc2045800/0xf8c13e2d0e95a2c9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864992.731282:0:14287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fdcc2045800/0xf8c13e2d0e95a2c9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864992.731289:0:14287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fdcc2045800/0xf8c13e2d0e95a2c9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864992.731296:0:14287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fdcc2045800/0xf8c13e2d0e95a2c9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864992.731301:0:14287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc2045800 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:2.0:1788864992.731305:0:14287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fdcc2045800/0xf8c13e2d0e95a2c9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864992.731312:0:14287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fdcc2045800/0xf8c13e2d0e95a2c9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864992.731333:0:14287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fdcc2045800/0xf8c13e2d0e95a2c9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864992.731354:0:14287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864992.731397:0:14287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:3301:x1875760546666624:12345-0@lo:103:ldlm_bl.0 Request processed in 204us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864992.731404:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788864992.731694:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3301:1875760546666624:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788864992.732169:0:14734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcb5385c00/0xf8c13e2d0e95a28a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e95a283 expref: 11 pid: 14295 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864992.732216:0:14734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86ebb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14734:1875760546666496:0@lo:104: 00010000:00010000:3.0:1788864992.732235:0:14734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fdcc2045800/0xf8c13e2d0e95a2c9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864992.732244:0:14734:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fdcc2045800/0xf8c13e2d0e95a2c9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864992.732250:0:14734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fdcc2045800/0xf8c13e2d0e95a2c9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864992.732257:0:14734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcc2045800/0xf8c13e2d0e95a2c9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864993.669922:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788864993.797272:0:14298:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788864993.797279:0:14298:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fdb812fc800 from 10 10000000:01000000:1.0:1788864993.797285:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788864993.797337:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e95a2d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864993.797349:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e95a2d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864993.797361:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e95a2d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864993.797387:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81926d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546666752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788864993.797466:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864993.797515:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca5a72840 going to sleep for 11 seconds 00000100:00100000:3.0:1788864993.797565:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546666752 00000100:00100000:3.0:1788864993.797573:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546666752 00000100:00100000:3.0:1788864993.797622:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788864993.797631:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+11:14298:x1875760546666752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788864993.797645:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864993.797657:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcc2044000/0xf8c13e2d0e95a2d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95a2d0 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864993.797680:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcc2044000/0xf8c13e2d0e95a2d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a2d0 expref: 12 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864993.797690:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcc2044000/0xf8c13e2d0e95a2d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a2d0 expref: 12 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864993.797698:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcc2044000, rc 0) 00000100:00100000:3.0:1788864993.797760:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:14298:x1875760546666752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864993.797767:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788864993.797949:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81926d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546666752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788864993.797963:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e95a2d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a2d7 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864993.797971:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e95a2d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95a2d7 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864993.798020:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81926d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546666880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788864993.798046:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864993.798158:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca5a72840 going to sleep for 11 seconds 00000100:00100000:3.0:1788864993.799090:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546666880 00000100:00100000:3.0:1788864993.799098:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546666880 00000100:00100000:3.0:1788864993.799141:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788864993.799157:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:14298:x1875760546666880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788864993.799692:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:14298:x1875760546666880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 534us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864993.799719:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788864993.800546:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81926d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546666880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788864993.800600:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81926d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546667008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788864993.800661:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864993.801566:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546667008 00000100:00100000:0.0:1788864993.801575:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546667008 00000100:00100000:0.0:1788864993.801672:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788864993.801684:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:14298:x1875760546667008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788864993.801926:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:14298:x1875760546667008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 245us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864993.801934:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788864993.802368:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca5a72840 going to sleep for 11 seconds 00000100:00100000:1.0:1788864993.802392:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81926d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546667008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788864993.804169:0:14787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788864993.804440:0:14298:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788864993.804465:0:14298:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788864993.804476:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e95a2d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a2d7 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864993.804487:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e95a2d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a2d7 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864994.116898:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788864984/real 1788864984] req@ffff9fdc86eb8a80 x1875760546663680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788864994 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864994.116955:0:3299:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fdc86eb8a80 x1875760546663680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788864994 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864994.116966:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788864984/real 1788864984] req@ffff9fdcac9cf800 x1875760546663552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788864994 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864994.116979:0:3299:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fdcac9cf800 x1875760546663552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788864994 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788864994.116997:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fdc83524000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788864994.117021:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788864994.117025:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875760546663680:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788864994.117031:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fdc837a9800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788864994.117036:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788864994.117039:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875760546663552:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788864994.117218:0:13016:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788864994.117226:0:13016:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788864994.117229:0:13016:0:(import.c:65:import_set_state_nolock()) ffff9fdc837a9800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788864994.117234:0:13016:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 407 00000100:00080000:2.0:1788864994.117239:0:13016:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788864994.117249:0:13016:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fdc837a9800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788864994.117268:0:13016:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fdcac9cea00 x1875760546667264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788864994.117281:0:13016:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788864994.117284:0:13016:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788864994.117286:0:13016:0:(import.c:65:import_set_state_nolock()) ffff9fdc83524000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788864994.117289:0:13016:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 407 00000100:00080000:2.0:1788864994.117291:0:13016:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788864994.117295:0:13016:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fdc83524000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788864994.117305:0:13016:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fdcac9cf100 x1875760546667392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788864994.117386:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875760546667520:0@lo:400:kworker.0 00000100:00100000:1.0:1788864994.117434:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864994.117488:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788864994.117494:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3303:1875760546667136:0@lo:400:kworker.0 00000100:00100000:1.0:1788864994.117524:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864994.117552:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875760546667264:0@lo:8:kworker.0 00000400:00000100:1.0:1788864994.117627:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875760546667264 offset 0 length 520: 4 00000100:00100000:1.0:1788864994.117641:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875760546667392:0@lo:8:kworker.0 00000400:00000100:1.0:1788864994.117658:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875760546667392 offset 0 length 520: 4 00000100:00100000:2.0:1788864994.117799:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546667520 00000100:00100000:2.0:1788864994.117808:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546667520 00000100:00100000:2.0:1788864994.117850:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788864994.117860:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875760546667520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864994.117936:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875760546667520:12345-0@lo:400:kworker.0 Request processed in 76us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864994.117944:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788864994.118150:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fdcac9cc000 x1875760546667520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788865010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864994.118170:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875760546667520:0@lo:400:kworker.0 00000100:00100000:3.0:1788864994.118253:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546667136 00000100:00100000:3.0:1788864994.118258:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546667136 00000100:00100000:3.0:1788864994.118400:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788864994.118408:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:3303:x1875760546667136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864994.118456:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:3303:x1875760546667136:12345-0@lo:400:kworker.0 Request processed in 49us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864994.118471:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788864994.118529:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3303:1875760546667136:0@lo:400:kworker.0 00010000:00010000:0.0:1788864994.692847:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864995.716818:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788864996.058352:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788864996.742909:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788864997.142251:0:14982:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788864997.142256:0:14982:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788864997.142401:0:14982:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fdc8339a000 00000020:01000004:2.0:1788864997.142417:0:14982:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788864997.142428:0:14982:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788864997.142439:0:14982:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9fdca1ff3380) 00000020:00000080:2.0:1788864997.142454:0:14982:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788864997.162625:0:14982:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788864997.162896:0:14982:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788864997.163957:0:14982:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788864997.164185:0:14982:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788864997.164434:0:14982:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788864997.164974:0:14982:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 441: rc = 0 00100000:10000000:0.0:1788864997.165071:0:14982:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 441: rc = 0 00100000:10000000:0.0:1788864997.165140:0:14982:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 441: rc = 0 00100000:10000000:0.0:1788864997.170104:0:14982:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 640: rc = 0 00100000:10000000:0.0:1788864997.172751:0:14982:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 640: rc = 0 00100000:10000000:0.0:1788864997.174072:0:14982:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 640: rc = 0 00100000:10000000:0.0:1788864997.175095:0:14982:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 640: rc = 0 00100000:10000000:0.0:1788864997.175425:0:14982:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 640: rc = 0 00100000:10000000:0.0:1788864997.176567:0:14982:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 640: rc = 0 00000020:00000080:0.0:1788864997.182111:0:14982:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788864997.182123:0:14982:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788864997.182142:0:14982:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf8c13e2d0e95a2e5 00000020:01000004:0.0:1788864997.182151:0:14982:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788864997.182172:0:14982:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788864997.182176:0:14982:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788864997.182194:0:14982:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788864997.182198:0:14982:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788864997.182209:0:14982:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9fdca14cb380) 00000020:00000080:0.0:1788864997.182218:0:14982:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788864997.185562:0:14982:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788864997.185808:0:14982:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788864997.185815:0:14982:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788864997.189971:0:14982:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788864997.189985:0:14982:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788864997.192680:0:14982:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788864997.192693:0:14982:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788864997.196872:0:14982:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788864997.197099:0:14982:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788864997.197107:0:14982:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788864997.198074:0:14982:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788864997.198085:0:14982:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788864997.216535:0:14982:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788864997.217049:0:14982:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788864997.217056:0:14982:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788864997.218874:0:14982:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788864997.218885:0:14982:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788864997.219899:0:14982:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788864997.219907:0:14982:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788864997.223359:0:14982:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788864997.223536:0:14982:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788864997.223543:0:14982:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788864997.225894:0:14982:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788864997.225907:0:14982:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788864997.259384:0:14982:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788864997.259587:0:14982:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788864997.259595:0:14982:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788864997.260938:0:14982:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788864997.260949:0:14982:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788864997.261395:0:14982:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788864997.261420:0:14982:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788864997.261426:0:14982:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788864997.271688:0:14982:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788864997.271813:0:14982:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788864997.271817:0:14982:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788864997.271819:0:14982:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788864997.271820:0:14982:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788864997.271822:0:14982:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788864997.271823:0:14982:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788864997.271824:0:14982:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788864997.271830:0:14982:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788864997.271832:0:14982:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788864997.271833:0:14982:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788864997.271836:0:14982:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788864997.271838:0:14982:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788864997.271839:0:14982:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788864997.271840:0:14982:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788864997.271841:0:14982:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788864997.271841:0:14982:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788864997.271842:0:14982:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788864997.271843:0:14982:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788864997.271844:0:14982:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788864997.271845:0:14982:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788864997.271870:0:14982:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788864997.271891:0:14982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86ebb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546667648:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788864997.271956:0:14982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864997.272068:0:14982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca15050c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864997.272251:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546667648 00000100:00100000:2.0:1788864997.272259:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546667648 00000100:00100000:2.0:1788864997.272322:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788864997.272332:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:14982:x1875760546667648:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788864997.272375:0:14295:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788864997.272379:0:14295:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788864997.272382:0:14295:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788864997.289452:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:14982:x1875760546667648:12345-0@lo:253:mount.lustre.0 Request processed in 17113us (17487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864997.289468:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788864997.289577:0:14982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86ebb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546667648:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788864997.289592:0:14982:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788864997.289595:0:14982:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788864997.289597:0:14982:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788864997.289598:0:14982:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788864997.289599:0:14982:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788864997.289600:0:14982:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788864997.289613:0:14982:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788864997.289615:0:14982:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788864997.289616:0:14982:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788864997.289618:0:14982:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788864997.289636:0:14982:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fdc8339a000 from lustre-OST0000 10000000:01000000:2.0:1788864997.289667:0:14982:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788864997.289670:0:14982:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788864997.289677:0:14982:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fdca5be19c0 local copy 00010000:00010000:2.0:1788864997.289687:0:14982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044e00/0xf8c13e2d0e95a1db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a1e2 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864997.289936:0:14982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546667776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788864997.289975:0:14982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864997.290005:0:14982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca03f43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788864997.290272:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546667776 00000100:00100000:3.0:1788864997.290279:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546667776 00000100:00100000:3.0:1788864997.290464:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788864997.290473:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:14982:x1875760546667776:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788864997.290638:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:14982:x1875760546667776:12345-0@lo:501:mount.lustre.0 Request processed in 166us (663us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788864997.290645:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788864997.290864:0:14982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546667776:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788864997.290879:0:14982:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788864997.291027:0:14982:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788864997.291035:0:14982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044e00/0xf8c13e2d0e95a1db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a1e2 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864997.291044:0:14982:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044e00/0xf8c13e2d0e95a1db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a1e2 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864997.291065:0:14982:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fdc8339a000 10000000:01000000:2.0:1788864997.291070:0:14982:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788864997.291075:0:14982:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9fdca5be19c0 10000000:01000000:2.0:1788864997.291077:0:14982:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788864997.291080:0:14982:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9fdca5be19c0 from 1 10000000:01000000:2.0:1788864997.291082:0:14982:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788864997.291106:0:14982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385c00/0xf8c13e2d0e95a2f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864997.291119:0:14982:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385c00/0xf8c13e2d0e95a2f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864997.294206:0:14982:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385c00/0xf8c13e2d0e95a2f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864997.294251:0:14982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546667904:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788864997.294338:0:14982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864997.294445:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546667904 00000100:00100000:3.0:1788864997.294453:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546667904 00000100:00100000:3.0:1788864997.294556:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788864997.294566:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+12:14982:x1875760546667904:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788864997.294579:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864997.294606:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcc2045000/0xf8c13e2d0e95a2fa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95a2f3 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864997.294629:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcc2045000/0xf8c13e2d0e95a2fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a2f3 expref: 13 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864997.294639:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcc2045000/0xf8c13e2d0e95a2fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a2f3 expref: 13 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864997.294648:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcc2045000, rc 0) 00000100:00100000:3.0:1788864997.294790:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+13:14982:x1875760546667904:12345-0@lo:101:mount.lustre.0 Request processed in 226us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864997.294797:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788864997.294964:0:14982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca03f43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864997.294984:0:14982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546667904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788864997.294998:0:14982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385c00/0xf8c13e2d0e95a2f3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a2fa expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864997.295008:0:14982:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385c00/0xf8c13e2d0e95a2f3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95a2fa expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864997.295027:0:14982:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788864997.295047:0:14982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385c00/0xf8c13e2d0e95a2f3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a2fa expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864997.295055:0:14982:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385c00/0xf8c13e2d0e95a2f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a2fa expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864997.295063:0:14982:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788864997.295068:0:14982:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788864997.295073:0:14982:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788864997.295076:0:14982:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788864997.295104:0:14982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385a00/0xf8c13e2d0e95a301 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864997.295112:0:14982:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385a00/0xf8c13e2d0e95a301 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864997.295120:0:14982:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385a00/0xf8c13e2d0e95a301 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864997.295134:0:14982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546668032:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788864997.295163:0:14982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864997.295186:0:14982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca03f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864997.296970:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546668032 00000100:00100000:0.0:1788864997.296982:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546668032 00000100:00100000:0.0:1788864997.297035:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788864997.297044:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+13:14982:x1875760546668032:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788864997.297057:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864997.297072:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdca2d4a800/0xf8c13e2d0e95a308 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95a301 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864997.297112:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdca2d4a800/0xf8c13e2d0e95a308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a301 expref: 14 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864997.297132:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdca2d4a800/0xf8c13e2d0e95a308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a301 expref: 14 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864997.297141:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4a800, rc 0) 00000100:00100000:0.0:1788864997.297211:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+14:14982:x1875760546668032:12345-0@lo:101:mount.lustre.0 Request processed in 168us (2047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864997.297219:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788864997.299069:0:14982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546668032:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788864997.299094:0:14982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385a00/0xf8c13e2d0e95a301 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a308 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864997.299106:0:14982:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385a00/0xf8c13e2d0e95a301 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95a308 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788864997.300076:0:14982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788864997.302041:0:14982:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788864997.302487:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788864997.302607:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788864997.302645:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788864997.302974:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788864997.303225:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788864997.303347:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788864997.303428:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788864997.303436:0:14982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788864997.303599:0:14982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546668160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788864997.303665:0:14982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864997.303944:0:14982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca15056c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864997.303985:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546668160 00000100:00100000:0.0:1788864997.303993:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546668160 00000100:00100000:0.0:1788864997.304144:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788864997.304155:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+14:14982:x1875760546668160:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788864997.304547:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+14:14982:x1875760546668160:12345-0@lo:501:mount.lustre.0 Request processed in 393us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864997.304557:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788864997.305905:0:14982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546668160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788864997.305957:0:14982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546668288:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788864997.306017:0:14982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864997.306055:0:14982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca03f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864997.306388:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546668288 00000100:00100000:0.0:1788864997.306395:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546668288 00000100:00100000:0.0:1788864997.306476:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788864997.306485:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+14:14982:x1875760546668288:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788864997.308363:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+14:14982:x1875760546668288:12345-0@lo:503:mount.lustre.0 Request processed in 1874us (2339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864997.308376:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788864997.308484:0:14982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546668288:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788864997.309520:0:14982:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788864997.309598:0:14982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546668416:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788864997.309656:0:14982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864997.309721:0:14982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca03f43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788864997.309911:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546668416 00000100:00100000:3.0:1788864997.309917:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546668416 00000100:00100000:3.0:1788864997.310013:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788864997.310024:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+14:14982:x1875760546668416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788864997.310622:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+14:14982:x1875760546668416:12345-0@lo:502:mount.lustre.0 Request processed in 598us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864997.310630:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788864997.310899:0:14982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546668416:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788864997.311159:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788864997.311386:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788864997.311417:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788864997.311460:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788864997.311492:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788864997.311525:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788864997.311571:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788864997.311601:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788864997.311629:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788864997.311673:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788864997.311732:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788864997.311787:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788864997.312004:0:14982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546668544:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788864997.312058:0:14982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864997.312090:0:14982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca03f43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788864997.312110:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546668544 00000100:00100000:3.0:1788864997.312117:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546668544 00000100:00100000:3.0:1788864997.312221:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788864997.312232:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+14:14982:x1875760546668544:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788864997.312424:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+14:14982:x1875760546668544:12345-0@lo:502:mount.lustre.0 Request processed in 195us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864997.312430:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788864997.313926:0:14982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546668544:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788864997.314070:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788864997.314084:0:14982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788864997.317449:0:14996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788864997.317461:0:14996:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788864997.317469:0:14996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864997.317538:0:14996:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788864997.317547:0:14996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788864997.317562:0:14996:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9fdc9f6499c0) 00000020:00000080:1.0:1788864997.317588:0:14996:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788864997.317596:0:14996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788864997.318073:0:14996:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fdc8339a000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788864997.318083:0:14996:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788864997.318090:0:14996:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf8c13e2d0e95a316 00010000:00010000:1.0:1788864997.324059:0:14996:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788864997.324586:0:14996:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1788864997.327652:0:14996:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788864997.331759:0:14996:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788864997.331773:0:14996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788864997.331780:0:14996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864997.331790:0:14996:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788864997.331794:0:14996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788864997.331798:0:14996:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1788864997.331799:0:14996:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788864997.331801:0:14996:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788864997.331802:0:14996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788864997.331805:0:14996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864997.331806:0:14996:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788864997.331808:0:14996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788864997.331811:0:14996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864997.331813:0:14996:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788864997.331816:0:14996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788864997.331818:0:14996:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788864997.331822:0:14996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788864997.331824:0:14996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864997.331825:0:14996:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788864997.331828:0:14996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788864997.331830:0:14996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864997.331838:0:14996:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788864997.331842:0:14996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788864997.331900:0:14996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788864997.331903:0:14996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864997.331904:0:14996:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788864997.331907:0:14996:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1788864997.332269:0:14982:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788864997.332309:0:14982:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788864997.332338:0:14982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385a00/0xf8c13e2d0e95a301 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a308 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864997.332350:0:14982:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdcb5385a00/0xf8c13e2d0e95a301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a308 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864997.332358:0:14982:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fdc8339a000 from 1 10000000:01000000:0.0:1788864997.332361:0:14982:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788864997.332393:0:14982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a31d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864997.332401:0:14982:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a31d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864997.332412:0:14982:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a31d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864997.332435:0:14982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546668672:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788864997.332631:0:14982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864997.332670:0:14982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc909026c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864997.332745:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546668672 00000100:00100000:1.0:1788864997.332752:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546668672 00000100:00100000:1.0:1788864997.332796:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788864997.332805:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+14:14982:x1875760546668672:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788864997.332817:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864997.332837:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcafc74c00/0xf8c13e2d0e95a324 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95a31d expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864997.332860:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcafc74c00/0xf8c13e2d0e95a324 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a31d expref: 15 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864997.332871:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcafc74c00/0xf8c13e2d0e95a324 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a31d expref: 15 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864997.332879:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc74c00, rc 0) 00000100:00100000:1.0:1788864997.332914:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+15:14982:x1875760546668672:12345-0@lo:101:mount.lustre.0 Request processed in 111us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864997.332931:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788864997.333238:0:14982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546668672:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788864997.333255:0:14982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a31d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a324 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864997.333264:0:14982:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a31d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95a324 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788864997.334067:0:14982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788864997.337079:0:14982:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788864997.343800:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788864997.343877:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788864997.343964:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788864997.343973:0:14982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788864997.344079:0:14982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546668800:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788864997.344163:0:14982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864997.344211:0:14982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1505300 going to sleep for 11 seconds 00000100:00100000:2.0:1788864997.344232:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546668800 00000100:00100000:2.0:1788864997.344239:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546668800 00000100:00100000:2.0:1788864997.344301:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788864997.344311:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+15:14982:x1875760546668800:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788864997.344967:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+15:14982:x1875760546668800:12345-0@lo:501:mount.lustre.0 Request processed in 657us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864997.344977:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788864997.345391:0:14982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546668800:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788864997.345431:0:14982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546668928:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788864997.345939:0:14982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864997.346067:0:14982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1505300 going to sleep for 11 seconds 00000100:00100000:0.0:1788864997.346108:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546668928 00000100:00100000:0.0:1788864997.346360:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546668928 00000100:00100000:0.0:1788864997.346408:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788864997.346417:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+15:14982:x1875760546668928:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788864997.347113:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+15:14982:x1875760546668928:12345-0@lo:503:mount.lustre.0 Request processed in 695us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864997.347130:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788864997.347403:0:14982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546668928:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788864997.349352:0:14982:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788864997.349438:0:14982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546669056:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788864997.349580:0:14982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864997.349620:0:14982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1505300 going to sleep for 11 seconds 00000100:00100000:2.0:1788864997.349730:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546669056 00000100:00100000:2.0:1788864997.349743:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546669056 00000100:00100000:2.0:1788864997.349897:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788864997.349909:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+15:14982:x1875760546669056:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788864997.350108:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+15:14982:x1875760546669056:12345-0@lo:502:mount.lustre.0 Request processed in 201us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864997.350361:0:14982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546669056:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788864997.350637:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788864997.350687:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788864997.350765:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788864997.351052:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788864997.351088:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788864997.351224:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788864997.351272:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788864997.351318:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788864997.351350:0:14982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546669184:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788864997.351405:0:14982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864997.351438:0:14982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1505300 going to sleep for 11 seconds 00000100:00100000:0.0:1788864997.351546:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546669184 00000100:00100000:0.0:1788864997.351551:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546669184 00000100:00100000:2.0:1788864997.354512:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788864997.354572:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788864997.354593:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:14982:x1875760546669184:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788864997.355333:0:14982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546669184:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788864997.355513:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+15:14982:x1875760546669184:12345-0@lo:502:mount.lustre.0 Request processed in 541us (3717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864997.355523:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000040:00080000:3.0:1788864997.355635:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788864997.355651:0:14982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788864997.357654:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788864997.357668:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864997.357680:0:15000:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788864997.357690:0:15000:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fdc8339a000 00000020:00000080:0.0:1788864997.357692:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788864997.357699:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788864997.357701:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864997.357739:0:15000:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788864997.357743:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788864997.357746:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864997.357747:0:15000:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788864997.357750:0:15000:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fdc8339a000 00000020:00000080:0.0:1788864997.357752:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788864997.357962:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788864997.357967:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864997.357969:0:15000:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788864997.357972:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788864997.357985:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864997.357987:0:15000:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788864997.357991:0:15000:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fdc8339a000 00000020:00000080:0.0:1788864997.357993:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788864997.358033:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788864997.358041:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864997.358043:0:15000:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788864997.358046:0:15000:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788864997.358386:0:14982:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788864997.358410:0:14982:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788864997.358435:0:14982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a31d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a324 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864997.358658:0:14982:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a31d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a324 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864997.358723:0:14982:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788864997.358727:0:14982:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fdc8339a000 10000000:01000000:3.0:1788864997.358729:0:14982:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fdc8339a000 10000000:01000000:3.0:1788864997.358733:0:14982:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788864997.358738:0:14982:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fdc8339a000 from 1 10000000:01000000:3.0:1788864997.358741:0:14982:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788864997.358775:0:14982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045800/0xf8c13e2d0e95a32b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864997.358783:0:14982:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045800/0xf8c13e2d0e95a32b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864997.358942:0:14982:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045800/0xf8c13e2d0e95a32b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864997.358972:0:14982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546669312:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788864997.359033:0:14982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864997.359102:0:14982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1505180 going to sleep for 11 seconds 00000100:00100000:0.0:1788864997.359369:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546669312 00000100:00100000:0.0:1788864997.359377:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546669312 00000100:00100000:0.0:1788864997.359421:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788864997.359429:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+15:14982:x1875760546669312:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788864997.359441:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864997.359612:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdca2d4bc00/0xf8c13e2d0e95a332 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95a32b expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864997.359633:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdca2d4bc00/0xf8c13e2d0e95a332 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a32b expref: 16 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864997.359644:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdca2d4bc00/0xf8c13e2d0e95a332 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a32b expref: 16 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864997.359651:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4bc00, rc 0) 00000100:00100000:0.0:1788864997.359769:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:14982:x1875760546669312:12345-0@lo:101:mount.lustre.0 Request processed in 340us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864997.359776:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788864997.359975:0:14982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546669312:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788864997.359989:0:14982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045800/0xf8c13e2d0e95a32b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a332 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864997.359998:0:14982:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045800/0xf8c13e2d0e95a32b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95a332 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788864997.362666:0:14982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788864997.364658:0:14982:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788864997.365409:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788864997.365457:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788864997.365493:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788864997.365545:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788864997.365581:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788864997.365630:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788864997.365674:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788864997.365857:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788864997.365916:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788864997.366218:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788864997.366271:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788864997.366336:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788864997.366372:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788864997.366410:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788864997.366460:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788864997.366500:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788864997.366533:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788864997.366595:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788864997.366631:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788864997.366665:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788864997.366740:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788864997.366778:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788864997.366828:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788864997.366878:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788864997.366914:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788864997.367408:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788864997.367494:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788864997.367532:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788864997.367613:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788864997.367621:0:14982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788864997.367759:0:14982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546669440:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788864997.368133:0:14982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864997.368242:0:14982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1505180 going to sleep for 11 seconds 00000100:00100000:1.0:1788864997.368348:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546669440 00000100:00100000:1.0:1788864997.368355:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546669440 00000100:00100000:1.0:1788864997.368396:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788864997.368405:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:14982:x1875760546669440:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788864997.368634:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:14982:x1875760546669440:12345-0@lo:501:mount.lustre.0 Request processed in 230us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864997.368642:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788864997.368748:0:14982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546669440:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788864997.368784:0:14982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546669568:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788864997.368825:0:14982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864997.368843:0:14982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1505180 going to sleep for 11 seconds 00000100:00100000:1.0:1788864997.368908:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546669568 00000100:00100000:1.0:1788864997.368913:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546669568 00000100:00100000:1.0:1788864997.369040:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788864997.369048:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:14982:x1875760546669568:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788864997.369301:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:14982:x1875760546669568:12345-0@lo:503:mount.lustre.0 Request processed in 253us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864997.369308:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788864997.369393:0:14982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546669568:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788864997.369877:0:14982:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788864997.370007:0:14982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546669696:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788864997.370048:0:14982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864997.370081:0:14982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1505180 going to sleep for 11 seconds 00000100:00100000:1.0:1788864997.370208:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546669696 00000100:00100000:1.0:1788864997.370219:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546669696 00000100:00100000:1.0:1788864997.370254:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788864997.370262:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:14982:x1875760546669696:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788864997.370461:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:14982:x1875760546669696:12345-0@lo:502:mount.lustre.0 Request processed in 198us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864997.370469:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788864997.370567:0:14982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546669696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788864997.370819:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788864997.370873:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788864997.370906:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788864997.371512:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788864997.371563:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788864997.371631:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788864997.371670:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788864997.371720:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788864997.371777:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788864997.371827:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788864997.371885:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788864997.371958:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788864997.372017:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788864997.372072:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788864997.372169:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788864997.372225:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788864997.372268:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788864997.372331:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788864997.372373:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788864997.372406:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788864997.372471:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788864997.372521:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788864997.372571:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788864997.372625:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788864997.372657:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788864997.372689:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788864997.372779:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788864997.372829:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788864997.372876:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788864997.372938:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788864997.372994:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788864997.373050:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788864997.373098:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788864997.373159:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788864997.373224:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788864997.373282:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788864997.373338:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788864997.373376:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788864997.373438:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788864997.373491:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788864997.373540:0:14982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546669824:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788864997.373614:0:14982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864997.373665:0:14982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1505180 going to sleep for 11 seconds 00000100:00100000:0.0:1788864997.377378:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546669824 00000100:00100000:0.0:1788864997.377393:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546669824 00000100:00100000:0.0:1788864997.377451:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788864997.377462:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:14982:x1875760546669824:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788864997.377779:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:14982:x1875760546669824:12345-0@lo:502:mount.lustre.0 Request processed in 317us (4163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864997.377787:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788864997.378781:0:14982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546669824:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788864997.378912:0:14982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788864997.378927:0:14982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788864997.383079:0:15005:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788864997.383095:0:15005:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9fdca1ff19c0) 00000020:00000080:2.0:1788864997.383116:0:15005:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788864997.383203:0:15005:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fdc8339a000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788864997.383207:0:15005:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fdc8339a000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788864997.383209:0:15005:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fdc8339a000 3 00010000:00080000:2.0:1788864997.383239:0:15005:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fdb819b3000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1788864997.385113:0:15005:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788864997.385322:0:15005:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788864997.385355:0:15005:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788864997.385368:0:15005:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf8c13e2d0e95a340 00000100:00080000:2.0:1788864997.385380:0:15005:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788864997.385389:0:15005:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fdb819b3000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788864997.385423:0:15005:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fdcac9cd880 x1875760546669952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788864997.385451:0:15005:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788864997.385475:0:13016:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788864997.385479:0:13016:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788864997.385481:0:13016:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788864997.385485:0:13016:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788864997.386552:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546670080:0@lo:400:kworker.0 00000100:00100000:2.0:1788864997.386691:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864997.387073:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546670080 00000100:00100000:0.0:1788864997.387083:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546670080 00000100:00100000:0.0:1788864997.387134:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788864997.387144:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546670080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864997.387208:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546670080:12345-0@lo:400:kworker.0 Request processed in 66us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864997.387216:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788864997.387431:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fdcac9cdf80 x1875760546670080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788865013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864997.387445:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546670080:0@lo:400:kworker.0 00000100:00100000:0.0:1788864997.389368:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875760546669952:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788864997.389435:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864997.389499:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546669952 00000100:00100000:0.0:1788864997.389506:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546669952 00000100:00100000:0.0:1788864997.389545:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788864997.389552:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875760546669952:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788864997.389579:0:14300:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 420 last 0 00000020:00000080:0.0:1788864997.389635:0:14300:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf8c13e2d0e95a347 00000004:00100000:0.0:1788864997.389649:0:14300:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788864997.389683:0:14300:0:(import.c:65:import_set_state_nolock()) ffff9fdca22ff800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788864997.389752:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875760546669952:12345-0@lo:38:llog_process_th.0 Request processed in 198us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864997.389759:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788864997.389796:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fdcac9cd880 x1875760546669952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788865007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864997.389807:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788864997.389821:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788864997.389829:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788864997.389834:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788864997.389837:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fdb819b3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788864997.389844:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875760546669952:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788864997.389972:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788864997.391637:0:14982:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788864997.391674:0:14982:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788864997.391693:0:14982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045800/0xf8c13e2d0e95a32b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a332 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864997.391722:0:14982:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045800/0xf8c13e2d0e95a32b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a332 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788864997.391776:0:14982:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788864997.391778:0:14982:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788864997.391780:0:14982:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788864997.391781:0:14982:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788864997.391783:0:14982:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788864997.391784:0:14982:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788864997.391786:0:14982:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788864997.391788:0:14982:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788864997.391789:0:14982:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788864997.391794:0:14982:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788864997.391796:0:14982:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788864997.391797:0:14982:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788864997.391798:0:14982:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788864997.391800:0:14982:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788864997.391801:0:14982:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788864997.391802:0:14982:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788864997.391803:0:14982:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788864997.391804:0:14982:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788864997.391805:0:14982:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788864997.391829:0:14982:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788864997.391849:0:14982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546670208:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788864997.392045:0:14982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864997.392114:0:14982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca8c2b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788864997.395114:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546670208 00000100:00100000:3.0:1788864997.395127:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546670208 00000100:00100000:3.0:1788864997.395210:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788864997.395221:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:14982:x1875760546670208:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788864997.395250:0:14293:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788864997.395263:0:14293:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788864997.450674:0:14293:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788864997.450692:0:14293:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788864997.450722:0:14317:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788864997.450727:0:14317:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788864997.450750:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fdcb5385200/0xf8c13e2d0e95a34e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864997.450768:0:14317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdca2d4b000/0xf8c13e2d0e95a2bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a2b4 expref: 16 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864997.450775:0:14317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fdcb5385200/0xf8c13e2d0e95a34e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864997.450826:0:14317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdca2d4b000/0xf8c13e2d0e95a2bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e95a2b4 expref: 16 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864997.450841:0:14317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fdca2d4b000/0xf8c13e2d0e95a2bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a2b4 expref: 16 pid: 14296 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864997.450855:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cdf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14317:1875760546670336:0@lo:104: 00000100:00100000:2.0:1788864997.450914:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864997.450984:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc84e8ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788864997.451345:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546670336 00000100:00100000:1.0:1788864997.451353:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546670336 00000100:00100000:1.0:1788864997.451404:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788864997.451413:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+3:14317:x1875760546670336:12345-0@lo:104: 00010000:00010000:1.0:1788864997.451425:0:14284:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95a2b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e95a2bb expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864997.451485:0:14284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788864997.451492:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+3:14317:x1875760546670336:12345-0@lo:104: Request processed in 80us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864997.451499:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788864997.451531:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788864997.451535:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95a2b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e95a2bb expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864997.451542:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc2045e00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:1.0:1788864997.451545:0:14290:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95a2b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e95a2bb expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864997.451553:0:14290:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95a2b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e95a2bb expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788864997.451560:0:14290:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95a2b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e95a2bb expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788864997.451573:0:14290:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788864997.451602:0:14290:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95a2b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95a2bb expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864997.451608:0:14290:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788864997.451630:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95a2b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95a2bb expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864997.451647:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdcc2045e00/0xf8c13e2d0e95a2b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95a2bb expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864997.451663:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864997.451664:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864997.451666:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864997.451685:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3301:1875760546670464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788864997.451746:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864997.451759:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cdf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14317:1875760546670336:0@lo:104: 00010000:00010000:0.0:1788864997.451778:0:14317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fdcb5385200/0xf8c13e2d0e95a34e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864997.451789:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546670464 00000100:00100000:1.0:1788864997.451793:0:14288:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546670464 00010000:00010000:1.0:1788864997.451809:0:14288:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdca2d4b000/0xf8c13e2d0e95a2bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a2b4 expref: 17 pid: 14296 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864997.451836:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788864997.451843:0:14288:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81926300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+17:3301:x1875760546670464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788864997.451854:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864997.451859:0:14288:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdca2d4b000/0xf8c13e2d0e95a2bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a2b4 expref: 17 pid: 14296 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864997.451869:0:14288:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdca2d4b000/0xf8c13e2d0e95a2bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a2b4 expref: 17 pid: 14296 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864997.451900:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdca2d4b000/0xf8c13e2d0e95a2bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e95a2b4 expref: 17 pid: 14296 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864997.451912:0:14288:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fdcb5385200/0xf8c13e2d0e95a34e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864997.451926:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcb5385200/0xf8c13e2d0e95a34e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788864997.451940:0:14288:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001212933s 00010000:00010000:1.0:1788864997.451944:0:14288:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fdcb5385200/0xf8c13e2d0e95a34e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864997.451951:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fdcb5385200/0xf8c13e2d0e95a34e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864997.451958:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fdcb5385200/0xf8c13e2d0e95a34e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864997.451965:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fdcb5385200/0xf8c13e2d0e95a34e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864997.451972:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385200 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788864997.451976:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fdcb5385200/0xf8c13e2d0e95a34e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864997.451983:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fdcb5385200/0xf8c13e2d0e95a34e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864997.452001:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fdcb5385200/0xf8c13e2d0e95a34e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864997.452017:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864997.452047:0:14288:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81926300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:3301:x1875760546670464:12345-0@lo:103:ldlm_bl.0 Request processed in 204us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864997.452054:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788864997.452077:0:14317:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fdcb5385200/0xf8c13e2d0e95a34e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864997.452084:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fdcb5385200/0xf8c13e2d0e95a34e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864997.452086:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3301:1875760546670464:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788864997.452092:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcb5385200/0xf8c13e2d0e95a34e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864997.483429:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+15:14982:x1875760546670208:12345-0@lo:253:mount.lustre.0 Request processed in 88202us (91375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864997.483443:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788864997.483812:0:14982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14982:1875760546670208:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788864997.483829:0:14982:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788864997.483832:0:14982:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788864997.483834:0:14982:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788864997.483836:0:14982:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788864997.483837:0:14982:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788864997.483838:0:14982:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788864997.483840:0:14982:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788864997.483841:0:14982:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788864997.483843:0:14982:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788864997.483844:0:14982:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788864997.483862:0:14982:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788864997.489898:0:14982:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788864997.490278:0:14982:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788864997.490451:0:14982:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788864997.490605:0:14982:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788864997.491339:0:14982:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788864997.491574:0:14982:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788864997.493348:0:14982:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788864997.546600:0:14982:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788864997.546610:0:14982:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788864997.546646:0:14982:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788864997.546700:0:14982:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788864997.546743:0:14982:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788864997.546766:0:14982:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788864997.769034:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864998.789356:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788864998.980821:0:14298:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788864998.980828:0:14298:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fdb812fc800 from 7 10000000:01000000:1.0:1788864998.980834:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788864998.980878:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75800/0xf8c13e2d0e95a355 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864998.980891:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75800/0xf8c13e2d0e95a355 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864998.980903:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75800/0xf8c13e2d0e95a355 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864998.980929:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81925c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546670592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788864998.980997:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864998.981087:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1e35f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788864998.986846:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546670592 00000100:00100000:0.0:1788864998.986859:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546670592 00000100:00100000:0.0:1788864998.988235:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788864998.988254:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+15:14298:x1875760546670592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788864998.988284:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864998.988305:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdca2d4b000/0xf8c13e2d0e95a35c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95a355 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864998.988334:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdca2d4b000/0xf8c13e2d0e95a35c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a355 expref: 16 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864998.988346:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdca2d4b000/0xf8c13e2d0e95a35c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a355 expref: 16 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864998.988356:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdca2d4b000, rc 0) 00000100:00100000:0.0:1788864998.988433:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:14298:x1875760546670592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (7435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864998.988440:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788864998.991914:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81925c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546670592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788864998.991940:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75800/0xf8c13e2d0e95a355 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a35c expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864998.991963:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75800/0xf8c13e2d0e95a355 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95a35c expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864998.992034:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546670720:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788864998.992097:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864998.992417:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc87205000 going to sleep for 11 seconds 00000100:00100000:1.0:1788864998.992530:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546670720 00000100:00100000:1.0:1788864998.992544:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546670720 00000100:00100000:1.0:1788864998.992582:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788864998.992591:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:14298:x1875760546670720:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788864998.992609:0:14296:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788864998.992623:0:14296:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788864998.992626:0:14296:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788864998.993007:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:14298:x1875760546670720:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 416us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864998.993015:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788864998.994310:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546670720:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788864998.994393:0:14298:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788864998.994403:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75800/0xf8c13e2d0e95a355 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a35c expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864998.994414:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75800/0xf8c13e2d0e95a355 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a35c expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864999.814818:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865000.836849:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865001.861606:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788865002.822176:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788865002.822183:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788865002.822186:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788865002.822197:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788865002.822207:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3302:1875760546670848:0@lo:400:kworker.0 00000100:00100000:3.0:1788865002.822268:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875760546670976:0@lo:400:kworker.0 00000100:00100000:0.0:1788865002.822281:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788865002.822299:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788865002.822348:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546670848 00000100:00100000:0.0:1788865002.822356:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546670848 00000100:00100000:0.0:1788865002.822395:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788865002.822404:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:3302:x1875760546670848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788865002.822453:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:3302:x1875760546670848:12345-0@lo:400:kworker.0 Request processed in 50us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865002.822469:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788865002.822687:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546670976 00000100:00100000:0.0:1788865002.822693:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546670976 00000100:00100000:0.0:1788865002.822737:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788865002.822743:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875760546670976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788865002.822775:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875760546670976:12345-0@lo:400:kworker.0 Request processed in 33us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865002.822781:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788865002.822818:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3302:1875760546670848:0@lo:400:kworker.0 00010000:00080000:3.0:1788865002.826180:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdc86eba300 x1875760546670976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788865018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788865002.826198:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875760546670976:0@lo:400:kworker.0 00000100:00100000:3.0:1788865002.826246:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546671104:0@lo:400:kworker.0 00000100:00100000:3.0:1788865002.826322:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788865002.826434:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546671104 00000100:00100000:0.0:1788865002.826441:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546671104 00000100:00100000:0.0:1788865002.826510:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788865002.826520:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546671104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788865002.826573:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546671104:12345-0@lo:400:kworker.0 Request processed in 56us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865002.826581:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788865002.826658:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdc86eb9c00 x1875760546671104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788865018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788865002.826669:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546671104:0@lo:400:kworker.0 00000100:00080000:3.0:1788865002.827628:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788865002.884799:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788865003.673210:0:15351:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788865003.915324:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865004.934834:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865005.956912:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788865006.286180:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788865006.981687:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788865007.941003:0:13016:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788865007.941010:0:13016:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788865007.941013:0:13016:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788865007.941022:0:13016:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788865007.941060:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788865007.941078:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3300:1875760546671232:0@lo:400:kworker.0 00000100:00100000:0.0:1788865007.941142:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788865007.941211:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546671360:0@lo:400:kworker.0 00000100:00100000:0.0:1788865007.941256:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788865007.941277:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788865007.941496:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546671232 00000100:00100000:3.0:1788865007.941507:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546671232 00000100:00100000:3.0:1788865007.941550:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788865007.941558:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:3300:x1875760546671232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788865007.941606:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:3300:x1875760546671232:12345-0@lo:400:kworker.0 Request processed in 48us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865007.941613:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788865007.941661:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3300:1875760546671232:0@lo:400:kworker.0 00000100:00100000:0.0:1788865007.942093:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546671488:0@lo:400:kworker.0 00000100:00100000:0.0:1788865007.942125:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788865007.942161:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546671360 00000100:00100000:0.0:1788865007.942165:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546671360 00000100:00100000:0.0:1788865007.942371:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546671488 00000100:00100000:0.0:1788865007.942375:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546671488 00000100:00100000:0.0:1788865007.942401:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788865007.942407:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546671360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788865007.942447:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546671360:12345-0@lo:400:kworker.0 Request processed in 39us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865007.942454:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788865007.942468:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788865007.942474:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546671488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788865007.942500:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546671488:12345-0@lo:400:kworker.0 Request processed in 27us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865007.942506:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788865007.942537:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdc9f45f100 x1875760546671488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788865023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788865007.942548:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546671488:0@lo:400:kworker.0 00010000:00080000:0.0:1788865007.942574:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdc9f45c000 x1875760546671360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788865023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788865007.942583:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546671360:0@lo:400:kworker.0 00000100:00080000:3.0:1788865007.942649:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788865008.008921:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865009.028906:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788865009.671406:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788864994/real 1788864994] req@ffff9fdcac9cea00 x1875760546667264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788865009 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788865009.671439:0:3299:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fdcac9cea00 x1875760546667264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788865009 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788865009.671449:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788864994/real 1788864994] req@ffff9fdcac9cf100 x1875760546667392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788865009 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788865009.671461:0:3299:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fdcac9cf100 x1875760546667392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788865009 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788865009.671493:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fdc837a9800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788865009.671521:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788865009.671526:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875760546667264:0@lo:8:kworker.0 00000100:00080000:2.0:1788865009.671532:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fdc83524000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788865009.671538:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788865009.671540:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875760546667392:0@lo:8:kworker.0 00000100:00080000:3.0:1788865009.671658:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788865009.671663:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788865009.671666:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fdc837a9800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788865009.671671:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 417 00000100:00080000:3.0:1788865009.671676:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788865009.671686:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fdc837a9800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788865009.671732:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fdc86eb8a80 x1875760546671744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788865009.671748:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788865009.671752:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788865009.671753:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fdc83524000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788865009.671757:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 417 00000100:00080000:3.0:1788865009.671760:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788865009.671765:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fdc83524000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788865009.671776:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fdc86eb9880 x1875760546671872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788865009.671821:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546672128:0@lo:400:kworker.0 00000100:00100000:3.0:1788865009.671877:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788865009.671937:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546672128 00000100:00100000:3.0:1788865009.671944:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546672128 00000100:00100000:3.0:1788865009.671998:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788865009.672007:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546672128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788865009.672055:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875760546672128:12345-0@lo:400:kworker.0 Request processed in 49us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865009.672062:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788865009.672082:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788865009.672107:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdc86eb8e00 x1875760546672128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788865025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788865009.672117:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875760546672128:0@lo:400:kworker.0 00000100:00100000:3.0:1788865009.672135:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875760546671744:0@lo:8:kworker.0 00000100:00100000:3.0:1788865009.672180:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788865009.672223:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875760546671872:0@lo:8:kworker.0 00000100:00100000:3.0:1788865009.672251:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788865009.672395:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875760546672000:0@lo:400:kworker.0 00000100:00100000:1.0:1788865009.672424:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788865009.672441:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788865009.672446:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3301:1875760546671616:0@lo:400:kworker.0 00000100:00100000:1.0:1788865009.672470:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788865009.672501:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546671744 00000100:00100000:1.0:1788865009.672506:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546671744 00000100:00100000:1.0:1788865009.672522:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546671872 00000100:00100000:1.0:1788865009.672525:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546671872 00000100:00100000:1.0:1788865009.672537:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788865009.672542:0:14985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1875760546671744:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788865009.672562:0:14985:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:1.0:1788865009.672592:0:14985:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf8c13e2d0e95a363 00002000:00100000:1.0:1788865009.672613:0:14985:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9fdcacbf1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788865009.672618:0:14985:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788865009.672620:0:14985:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788865009.672940:0:14985:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788865009.672962:0:14985:0:(import.c:65:import_set_state_nolock()) ffff9fdcacbf3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788865009.672999:0:14985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1875760546671744:12345-0@lo:8:kworker.0 Request processed in 456us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865009.673007:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788865009.673021:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788865009.673026:0:14985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1875760546671872:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788865009.673036:0:14985:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788865009.673060:0:14985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1875760546671872:12345-0@lo:8:kworker.0 Request processed in 33us (809us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788865009.673066:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788865009.673084:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546671616 00000100:00100000:1.0:1788865009.673088:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546671616 00000100:00100000:1.0:1788865009.673111:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788865009.673118:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:3301:x1875760546671616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788865009.673150:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:3301:x1875760546671616:12345-0@lo:400:kworker.0 Request processed in 33us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865009.673157:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788865009.673217:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3301:1875760546671616:0@lo:400:kworker.0 00000100:00100000:3.0:1788865009.673346:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546672000 00000100:00100000:3.0:1788865009.673351:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546672000 00000100:00100000:3.0:1788865009.673386:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788865009.673392:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875760546672000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788865009.673434:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875760546672000:12345-0@lo:400:kworker.0 Request processed in 42us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865009.673440:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788865009.673480:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdc86eb8a80 x1875760546671744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788865029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788865009.673488:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788865009.673495:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788865009.673501:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788865009.673506:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788865009.673508:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fdc837a9800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788865009.673518:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788865009.673522:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875760546671744:0@lo:8:kworker.0 00000100:00080000:3.0:1788865009.673533:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fdc83524000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788865009.673536:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788865009.673539:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875760546671872:0@lo:8:kworker.0 00000004:00080000:2.0:1788865009.673616:0:14324:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788865009.673634:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14324:1875760546672384:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788865009.673663:0:14324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788865009.673680:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1fd0840 going to sleep for 11 seconds 00000100:00100000:2.0:1788865009.673697:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546672384 00000100:00100000:2.0:1788865009.673719:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546672384 00000100:00100000:2.0:1788865009.673749:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788865009.673755:0:14985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14324:x1875760546672384:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788865009.676125:0:14985:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788865009.676135:0:14985:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788865009.676141:0:14985:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00100000:3.0:1788865009.676825:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546672256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788865009.676887:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788865009.676936:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788865009.677054:0:14323:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788865009.677422:0:14323:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 432808716852ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788865009.677476:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546672256 00000100:00100000:1.0:1788865009.677484:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546672256 00000100:00100000:1.0:1788865009.677523:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788865009.677530:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875760546672256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788865009.677561:0:14987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788865009.677610:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875760546672256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865009.677616:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788865009.677654:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdc86eb9f80 x1875760546672000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788865025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788865009.677667:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875760546672000:0@lo:400:kworker.0 00002000:00010000:2.0:1788865009.692377:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788865009.692388:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e95a36a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865009.692404:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=432s v=(0 0) 00010000:00010000:2.0:1788865009.692408:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788865009.692415:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e95a36a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865009.692443:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e95a36a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865009.692453:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e95a36a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865009.692460:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e95a36a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865009.692493:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788865009.692753:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788865009.692761:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e95a36a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.692770:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384e00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788865009.692774:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e95a36a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.692783:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e95a36a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.692801:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e95a36a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.692812:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c759f10/0xf8c13e2d0e95a36a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.692834:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865009.692836:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865009.692838:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1788865009.700048:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdcac9cf100 x1875760546672256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788865025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788865009.700092:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546672256:0@lo:13:osp-pre-0-0.0 00002000:00010000:2.0:1788865009.704991:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788865009.705003:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601dbfb2/0xf8c13e2d0e95a371 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865009.705021:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=432s v=(0 0) 00010000:00010000:2.0:1788865009.705026:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788865009.705032:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000601dbfb2/0xf8c13e2d0e95a371 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865009.705047:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601dbfb2/0xf8c13e2d0e95a371 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865009.705058:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601dbfb2/0xf8c13e2d0e95a371 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865009.705077:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000601dbfb2/0xf8c13e2d0e95a371 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865009.705106:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788865009.705560:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788865009.705562:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788865009.705569:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001564a778/0xf8c13e2d0e95a378 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.705572:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000601dbfb2/0xf8c13e2d0e95a371 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865009.705587:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1788865009.705589:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385400 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:2.0:1788865009.705593:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788865009.705596:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000601dbfb2/0xf8c13e2d0e95a371 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865009.705600:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001564a778/0xf8c13e2d0e95a378 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.705614:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000601dbfb2/0xf8c13e2d0e95a371 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865009.705619:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001564a778/0xf8c13e2d0e95a378 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865009.705634:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001564a778/0xf8c13e2d0e95a378 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.705644:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000601dbfb2/0xf8c13e2d0e95a371 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865009.705645:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001564a778/0xf8c13e2d0e95a378 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.705668:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601dbfb2/0xf8c13e2d0e95a371 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865009.705681:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788865009.705793:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788865009.705798:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001564a778/0xf8c13e2d0e95a378 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.705806:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385800 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865009.705811:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001564a778/0xf8c13e2d0e95a378 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.705821:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001564a778/0xf8c13e2d0e95a378 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.705835:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001564a778/0xf8c13e2d0e95a378 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.705843:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001564a778/0xf8c13e2d0e95a378 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.705861:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865009.705864:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865009.705868:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788865009.706087:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788865009.706343:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788865009.706349:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ce982de/0xf8c13e2d0e95a37f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865009.706365:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=432s v=(0 0) 00010000:00010000:2.0:1788865009.706368:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788865009.706372:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ce982de/0xf8c13e2d0e95a37f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865009.706382:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ce982de/0xf8c13e2d0e95a37f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865009.706390:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ce982de/0xf8c13e2d0e95a37f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865009.706397:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ce982de/0xf8c13e2d0e95a37f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865009.706423:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788865009.707542:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788865009.707551:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ce982de/0xf8c13e2d0e95a37f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.707572:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384a00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865009.707586:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ce982de/0xf8c13e2d0e95a37f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.707595:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ce982de/0xf8c13e2d0e95a37f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.707612:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ce982de/0xf8c13e2d0e95a37f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.707619:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ce982de/0xf8c13e2d0e95a37f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.707636:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865009.707638:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865009.707640:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865009.711320:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865009.711334:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e16a601a/0xf8c13e2d0e95a386 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.711360:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1788865009.711364:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865009.711371:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e16a601a/0xf8c13e2d0e95a386 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.711386:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e16a601a/0xf8c13e2d0e95a386 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.711397:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e16a601a/0xf8c13e2d0e95a386 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.711404:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e16a601a/0xf8c13e2d0e95a386 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.711426:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788865009.711910:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865009.711916:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007c1543c/0xf8c13e2d0e95a38d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.711927:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1788865009.711930:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865009.711935:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007c1543c/0xf8c13e2d0e95a38d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.711945:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007c1543c/0xf8c13e2d0e95a38d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.711965:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007c1543c/0xf8c13e2d0e95a38d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.711973:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007c1543c/0xf8c13e2d0e95a38d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.711985:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788865009.712386:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865009.712393:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000946579a6/0xf8c13e2d0e95a394 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.712402:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1788865009.712405:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865009.712409:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000946579a6/0xf8c13e2d0e95a394 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.712419:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000946579a6/0xf8c13e2d0e95a394 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.712427:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000946579a6/0xf8c13e2d0e95a394 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.712434:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000946579a6/0xf8c13e2d0e95a394 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.712458:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788865009.712914:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865009.712920:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a201b80/0xf8c13e2d0e95a39b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.712930:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1788865009.712933:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865009.712938:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a201b80/0xf8c13e2d0e95a39b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.712948:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a201b80/0xf8c13e2d0e95a39b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.712956:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a201b80/0xf8c13e2d0e95a39b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.712964:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a201b80/0xf8c13e2d0e95a39b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.712972:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788865009.713378:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865009.713385:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be1bb9c1/0xf8c13e2d0e95a3a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.713395:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1788865009.713403:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865009.713408:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be1bb9c1/0xf8c13e2d0e95a3a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.713418:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be1bb9c1/0xf8c13e2d0e95a3a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.713425:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be1bb9c1/0xf8c13e2d0e95a3a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.713431:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be1bb9c1/0xf8c13e2d0e95a3a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.713439:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788865009.713845:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865009.713852:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e95a3a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.713860:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1788865009.713862:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865009.713867:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e95a3a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.713876:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e95a3a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.713884:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e95a3a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.713898:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e95a3a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.713906:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1788865009.714255:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788865009.714263:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e16a601a/0xf8c13e2d0e95a386 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714272:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4be00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865009.714276:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e16a601a/0xf8c13e2d0e95a386 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714286:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e16a601a/0xf8c13e2d0e95a386 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714303:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e16a601a/0xf8c13e2d0e95a386 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714318:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e16a601a/0xf8c13e2d0e95a386 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714337:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788865009.714340:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007c1543c/0xf8c13e2d0e95a38d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714347:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a400 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865009.714350:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007c1543c/0xf8c13e2d0e95a38d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714359:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007c1543c/0xf8c13e2d0e95a38d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714369:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007c1543c/0xf8c13e2d0e95a38d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714376:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007c1543c/0xf8c13e2d0e95a38d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714387:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788865009.714390:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000946579a6/0xf8c13e2d0e95a394 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714397:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4b600 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865009.714406:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000946579a6/0xf8c13e2d0e95a394 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714413:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000946579a6/0xf8c13e2d0e95a394 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714422:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000946579a6/0xf8c13e2d0e95a394 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714429:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000946579a6/0xf8c13e2d0e95a394 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714441:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788865009.714444:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a201b80/0xf8c13e2d0e95a39b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714450:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a600 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865009.714454:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a201b80/0xf8c13e2d0e95a39b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714461:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a201b80/0xf8c13e2d0e95a39b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714469:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a201b80/0xf8c13e2d0e95a39b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714476:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a201b80/0xf8c13e2d0e95a39b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714496:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788865009.714499:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be1bb9c1/0xf8c13e2d0e95a3a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714506:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a200 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865009.714509:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be1bb9c1/0xf8c13e2d0e95a3a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714516:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be1bb9c1/0xf8c13e2d0e95a3a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714526:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be1bb9c1/0xf8c13e2d0e95a3a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714533:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be1bb9c1/0xf8c13e2d0e95a3a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714544:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788865009.714547:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e95a3a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714553:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4b800 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865009.714557:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e95a3a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714576:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e95a3a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714586:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e95a3a9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714593:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033bfe1db/0xf8c13e2d0e95a3a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.714606:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865009.714608:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865009.714610:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865009.714617:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865009.719136:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865009.719147:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3db56c9/0xf8c13e2d0e95a3b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.719165:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1788865009.719170:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865009.719176:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3db56c9/0xf8c13e2d0e95a3b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.719190:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3db56c9/0xf8c13e2d0e95a3b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.722046:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3db56c9/0xf8c13e2d0e95a3b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.722069:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3db56c9/0xf8c13e2d0e95a3b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.722097:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788865009.722640:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865009.722647:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e136c15/0xf8c13e2d0e95a3b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.722666:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1788865009.722670:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865009.722676:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e136c15/0xf8c13e2d0e95a3b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.722690:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e136c15/0xf8c13e2d0e95a3b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.722700:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e136c15/0xf8c13e2d0e95a3b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.722724:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e136c15/0xf8c13e2d0e95a3b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.722739:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788865009.723073:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865009.723078:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005889d613/0xf8c13e2d0e95a3be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.723087:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1788865009.723090:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865009.723093:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005889d613/0xf8c13e2d0e95a3be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.723102:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005889d613/0xf8c13e2d0e95a3be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.723122:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005889d613/0xf8c13e2d0e95a3be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.723129:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005889d613/0xf8c13e2d0e95a3be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.723137:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788865009.723503:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865009.723509:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079cfcb92/0xf8c13e2d0e95a3c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.723517:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1788865009.723520:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865009.723524:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079cfcb92/0xf8c13e2d0e95a3c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.723534:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079cfcb92/0xf8c13e2d0e95a3c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.723541:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079cfcb92/0xf8c13e2d0e95a3c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.723549:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079cfcb92/0xf8c13e2d0e95a3c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.723569:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788865009.723971:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865009.723977:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d3bd76d/0xf8c13e2d0e95a3cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.723987:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1788865009.723990:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865009.723995:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d3bd76d/0xf8c13e2d0e95a3cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.724005:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d3bd76d/0xf8c13e2d0e95a3cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.724014:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d3bd76d/0xf8c13e2d0e95a3cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.724021:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d3bd76d/0xf8c13e2d0e95a3cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.724030:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1788865009.725211:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788865009.725222:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3db56c9/0xf8c13e2d0e95a3b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.725233:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4aa00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865009.725238:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3db56c9/0xf8c13e2d0e95a3b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.725249:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3db56c9/0xf8c13e2d0e95a3b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.725268:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3db56c9/0xf8c13e2d0e95a3b0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.725284:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3db56c9/0xf8c13e2d0e95a3b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.725304:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788865009.725307:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e136c15/0xf8c13e2d0e95a3b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.725313:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4a000 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865009.725316:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e136c15/0xf8c13e2d0e95a3b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.725323:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e136c15/0xf8c13e2d0e95a3b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.725334:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e136c15/0xf8c13e2d0e95a3b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.725341:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e136c15/0xf8c13e2d0e95a3b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.725352:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788865009.725356:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005889d613/0xf8c13e2d0e95a3be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.725362:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4ac00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865009.725372:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005889d613/0xf8c13e2d0e95a3be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.725380:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005889d613/0xf8c13e2d0e95a3be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.725391:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005889d613/0xf8c13e2d0e95a3be lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.725398:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005889d613/0xf8c13e2d0e95a3be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.725411:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788865009.725414:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079cfcb92/0xf8c13e2d0e95a3c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.725420:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdc81496e00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865009.725423:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079cfcb92/0xf8c13e2d0e95a3c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.725431:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079cfcb92/0xf8c13e2d0e95a3c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.725440:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079cfcb92/0xf8c13e2d0e95a3c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.725448:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079cfcb92/0xf8c13e2d0e95a3c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.725468:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788865009.725472:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d3bd76d/0xf8c13e2d0e95a3cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.725478:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdc81497c00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865009.725482:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d3bd76d/0xf8c13e2d0e95a3cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.725489:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d3bd76d/0xf8c13e2d0e95a3cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.725500:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d3bd76d/0xf8c13e2d0e95a3cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.725507:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d3bd76d/0xf8c13e2d0e95a3cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.725519:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865009.725521:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865009.725523:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865009.725530:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865009.735565:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865009.735580:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbadcd19/0xf8c13e2d0e95a3d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.735597:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1788865009.735609:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865009.735615:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbadcd19/0xf8c13e2d0e95a3d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.735631:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbadcd19/0xf8c13e2d0e95a3d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.735642:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbadcd19/0xf8c13e2d0e95a3d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.735650:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbadcd19/0xf8c13e2d0e95a3d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.735671:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788865009.735684:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788865009.735690:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbadcd19/0xf8c13e2d0e95a3d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.735698:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdc81496600 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788865009.735728:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbadcd19/0xf8c13e2d0e95a3d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.735738:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbadcd19/0xf8c13e2d0e95a3d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.735755:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbadcd19/0xf8c13e2d0e95a3d3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.735773:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbadcd19/0xf8c13e2d0e95a3d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.735791:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865009.735793:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865009.735795:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865009.736327:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865009.736335:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9ca757e/0xf8c13e2d0e95a3da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.736345:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1788865009.736349:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865009.736353:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9ca757e/0xf8c13e2d0e95a3da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.736363:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9ca757e/0xf8c13e2d0e95a3da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.736371:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9ca757e/0xf8c13e2d0e95a3da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.736378:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9ca757e/0xf8c13e2d0e95a3da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.736397:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788865009.736407:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788865009.736416:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9ca757e/0xf8c13e2d0e95a3da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.736424:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdc81497600 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788865009.736427:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9ca757e/0xf8c13e2d0e95a3da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.736434:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9ca757e/0xf8c13e2d0e95a3da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.736446:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9ca757e/0xf8c13e2d0e95a3da lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.736453:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9ca757e/0xf8c13e2d0e95a3da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.736468:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865009.736470:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865009.736471:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865009.736893:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865009.736900:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd657d99/0xf8c13e2d0e95a3e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.736909:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1788865009.736913:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865009.736916:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd657d99/0xf8c13e2d0e95a3e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.736938:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd657d99/0xf8c13e2d0e95a3e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.736947:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd657d99/0xf8c13e2d0e95a3e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.736954:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd657d99/0xf8c13e2d0e95a3e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.736969:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788865009.736977:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788865009.736981:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd657d99/0xf8c13e2d0e95a3e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.736987:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdc81496800 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788865009.736990:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd657d99/0xf8c13e2d0e95a3e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.736996:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd657d99/0xf8c13e2d0e95a3e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.737005:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd657d99/0xf8c13e2d0e95a3e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.737011:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd657d99/0xf8c13e2d0e95a3e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.737032:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865009.737034:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865009.737036:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865009.737433:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865009.737439:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002e2bbb0/0xf8c13e2d0e95a3e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.737448:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1788865009.737451:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865009.737455:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002e2bbb0/0xf8c13e2d0e95a3e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.737463:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002e2bbb0/0xf8c13e2d0e95a3e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.737470:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002e2bbb0/0xf8c13e2d0e95a3e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.737477:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002e2bbb0/0xf8c13e2d0e95a3e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.737489:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788865009.737496:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788865009.737500:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002e2bbb0/0xf8c13e2d0e95a3e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.737516:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdc81497400 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788865009.737520:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002e2bbb0/0xf8c13e2d0e95a3e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.737527:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002e2bbb0/0xf8c13e2d0e95a3e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.737537:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002e2bbb0/0xf8c13e2d0e95a3e8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.737545:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002e2bbb0/0xf8c13e2d0e95a3e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.737558:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865009.737560:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865009.737561:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865009.737930:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865009.737935:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039a93919/0xf8c13e2d0e95a3ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.737943:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1788865009.737946:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865009.737950:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039a93919/0xf8c13e2d0e95a3ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.737959:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039a93919/0xf8c13e2d0e95a3ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.737972:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039a93919/0xf8c13e2d0e95a3ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.737979:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039a93919/0xf8c13e2d0e95a3ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.737991:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788865009.737999:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788865009.738002:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039a93919/0xf8c13e2d0e95a3ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.738008:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc05bc400 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788865009.738012:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039a93919/0xf8c13e2d0e95a3ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.738019:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039a93919/0xf8c13e2d0e95a3ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.738029:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039a93919/0xf8c13e2d0e95a3ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.738036:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039a93919/0xf8c13e2d0e95a3ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.738048:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865009.738056:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865009.738057:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788865009.739164:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788865009.739174:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f20212a8/0xf8c13e2d0e95a3f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.739188:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1788865009.739199:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788865009.739215:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f20212a8/0xf8c13e2d0e95a3f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.739228:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f20212a8/0xf8c13e2d0e95a3f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.739237:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f20212a8/0xf8c13e2d0e95a3f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.739244:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f20212a8/0xf8c13e2d0e95a3f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.739261:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788865009.739647:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788865009.739653:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf64ec9c/0xf8c13e2d0e95a3fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.739662:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1788865009.739665:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788865009.739669:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf64ec9c/0xf8c13e2d0e95a3fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.739678:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf64ec9c/0xf8c13e2d0e95a3fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.739686:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf64ec9c/0xf8c13e2d0e95a3fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.739699:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf64ec9c/0xf8c13e2d0e95a3fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.739757:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788865009.740137:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788865009.740143:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7113f0f/0xf8c13e2d0e95a404 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.740151:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1788865009.740154:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788865009.740158:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7113f0f/0xf8c13e2d0e95a404 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.740168:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7113f0f/0xf8c13e2d0e95a404 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.740176:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7113f0f/0xf8c13e2d0e95a404 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.740182:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7113f0f/0xf8c13e2d0e95a404 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.740191:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788865009.740591:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788865009.740598:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6672d98/0xf8c13e2d0e95a40b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.740612:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1788865009.740615:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788865009.740620:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6672d98/0xf8c13e2d0e95a40b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.740629:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6672d98/0xf8c13e2d0e95a40b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.740636:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6672d98/0xf8c13e2d0e95a40b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.740643:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6672d98/0xf8c13e2d0e95a40b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.740652:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788865009.741076:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788865009.741083:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4448e64/0xf8c13e2d0e95a412 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.741091:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1788865009.741095:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788865009.741099:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4448e64/0xf8c13e2d0e95a412 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.741108:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4448e64/0xf8c13e2d0e95a412 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.741126:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4448e64/0xf8c13e2d0e95a412 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.741133:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4448e64/0xf8c13e2d0e95a412 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.741141:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788865009.741563:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788865009.741570:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a419 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.741579:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1788865009.741582:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788865009.741587:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a419 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.741596:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a419 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.741605:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a419 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.741612:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a419 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.741632:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1788865009.742041:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788865009.742047:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062da7701/0xf8c13e2d0e95a420 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.742057:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1788865009.742060:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788865009.742064:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062da7701/0xf8c13e2d0e95a420 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.742074:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062da7701/0xf8c13e2d0e95a420 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.742083:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062da7701/0xf8c13e2d0e95a420 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.742090:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062da7701/0xf8c13e2d0e95a420 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865009.742099:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00080000:1.0:1788865009.742917:0:14985:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1788865009.743008:0:14985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14324:x1875760546672384:12345-0@lo:5:osp-pre-0-0.0 Request processed in 69249us (69340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865009.743018:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788865009.744293:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14324:1875760546672384:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788865009.744319:0:14324:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1788865009.744367:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81926680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14324:1875760546672512:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788865009.744412:0:14324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788865009.744463:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc91395e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788865009.744481:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546672512 00000100:00100000:1.0:1788865009.744486:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546672512 00000100:00100000:1.0:1788865009.744535:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788865009.744544:0:14986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14324:x1875760546672512:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788865009.744585:0:14986:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:0.0:1788865009.750587:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788865009.750600:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f20212a8/0xf8c13e2d0e95a3f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.750613:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74a00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788865009.750619:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f20212a8/0xf8c13e2d0e95a3f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.750631:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f20212a8/0xf8c13e2d0e95a3f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.750650:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f20212a8/0xf8c13e2d0e95a3f6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.750657:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f20212a8/0xf8c13e2d0e95a3f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753047:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788865009.753058:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf64ec9c/0xf8c13e2d0e95a3fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753070:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75600 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788865009.753075:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf64ec9c/0xf8c13e2d0e95a3fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753096:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf64ec9c/0xf8c13e2d0e95a3fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753115:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf64ec9c/0xf8c13e2d0e95a3fd lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753123:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf64ec9c/0xf8c13e2d0e95a3fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753138:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788865009.753142:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7113f0f/0xf8c13e2d0e95a404 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753148:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74e00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788865009.753151:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7113f0f/0xf8c13e2d0e95a404 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753159:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7113f0f/0xf8c13e2d0e95a404 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753167:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7113f0f/0xf8c13e2d0e95a404 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753174:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7113f0f/0xf8c13e2d0e95a404 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753195:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788865009.753198:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6672d98/0xf8c13e2d0e95a40b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753216:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74400 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788865009.753219:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6672d98/0xf8c13e2d0e95a40b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753226:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6672d98/0xf8c13e2d0e95a40b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753236:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6672d98/0xf8c13e2d0e95a40b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753242:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6672d98/0xf8c13e2d0e95a40b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753255:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788865009.753258:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4448e64/0xf8c13e2d0e95a412 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753264:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74200 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788865009.753267:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4448e64/0xf8c13e2d0e95a412 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753286:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4448e64/0xf8c13e2d0e95a412 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753298:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4448e64/0xf8c13e2d0e95a412 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753304:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4448e64/0xf8c13e2d0e95a412 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753317:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788865009.753321:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a419 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753327:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75e00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788865009.753331:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a419 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753337:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a419 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753346:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a419 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753353:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a419 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753377:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788865009.753380:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062da7701/0xf8c13e2d0e95a420 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753387:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74800 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788865009.753390:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062da7701/0xf8c13e2d0e95a420 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753398:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062da7701/0xf8c13e2d0e95a420 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753408:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062da7701/0xf8c13e2d0e95a420 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753415:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062da7701/0xf8c13e2d0e95a420 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865009.753426:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865009.753428:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865009.753430:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865009.753437:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788865009.755948:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788865009.760438:0:14986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14324:x1875760546672512:12345-0@lo:5:osp-pre-0-0.0 Request processed in 15880us (16011us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788865009.760455:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788865009.760898:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81926680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14324:1875760546672512:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788865009.760916:0:14324:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1788865010.060410:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788865010.456860:0:15701:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788865010.456865:0:15701:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788865010.456971:0:15701:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fdc82ac3800 00000020:01000004:0.0:1788865010.456987:0:15701:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788865010.456999:0:15701:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788865010.457020:0:15701:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9fdca14c8000) 00000020:00000080:0.0:1788865010.457037:0:15701:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788865010.495005:0:15701:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788865010.495242:0:15701:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788865010.495964:0:15701:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788865010.501583:0:15701:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788865010.502123:0:15701:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788865010.503233:0:15701:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 645: rc = 0 00100000:10000000:2.0:1788865010.503325:0:15701:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 645: rc = 0 00100000:10000000:2.0:1788865010.503432:0:15701:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 645: rc = 0 00100000:10000000:2.0:1788865010.504521:0:15701:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 667: rc = 0 00100000:10000000:2.0:1788865010.504813:0:15701:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 667: rc = 0 00100000:10000000:2.0:1788865010.505052:0:15701:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 667: rc = 0 00100000:10000000:2.0:1788865010.506174:0:15701:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 667: rc = 0 00100000:10000000:2.0:1788865010.506533:0:15701:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 667: rc = 0 00100000:10000000:3.0:1788865010.507510:0:15701:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 667: rc = 0 00000020:00000080:3.0:1788865010.508276:0:15701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788865010.508288:0:15701:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788865010.508298:0:15701:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf8c13e2d0e95a42e 00000020:01000004:3.0:1788865010.508305:0:15701:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788865010.508394:0:15701:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788865010.508399:0:15701:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788865010.508405:0:15701:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788865010.508426:0:15701:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788865010.508431:0:15701:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788865010.519343:0:15701:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788865010.519387:0:15701:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.113@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788865010.519392:0:15701:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788865010.519394:0:15701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788865010.519395:0:15701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788865010.519396:0:15701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788865010.519397:0:15701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788865010.519398:0:15701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788865010.519399:0:15701:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788865010.519401:0:15701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788865010.519402:0:15701:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788865010.519406:0:15701:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788865010.519408:0:15701:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788865010.519409:0:15701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788865010.519410:0:15701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788865010.519411:0:15701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788865010.519412:0:15701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788865010.519413:0:15701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788865010.519414:0:15701:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788865010.519415:0:15701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788865010.519416:0:15701:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788865010.519446:0:15701:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788865010.519466:0:15701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546672640:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788865010.519532:0:15701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788865010.519686:0:15701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc833299c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788865010.519880:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546672640 00000100:00100000:0.0:1788865010.519888:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546672640 00000100:00100000:0.0:1788865010.519938:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788865010.519947:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:15701:x1875760546672640:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788865010.519989:0:14296:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788865010.519992:0:14296:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788865010.519997:0:14296:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788865010.534515:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:15701:x1875760546672640:12345-0@lo:253:mount.lustre.0 Request processed in 14377us (14791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865010.534531:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788865010.535047:0:15701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546672640:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788865010.535062:0:15701:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788865010.535066:0:15701:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788865010.535068:0:15701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788865010.535069:0:15701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788865010.535071:0:15701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788865010.535072:0:15701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788865010.535073:0:15701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788865010.535074:0:15701:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788865010.535076:0:15701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788865010.535078:0:15701:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788865010.535099:0:15701:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fdc82ac3800 from lustre-OST0001 10000000:01000000:0.0:1788865010.535128:0:15701:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788865010.535130:0:15701:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788865010.535137:0:15701:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fdca5be19c0 local copy 00010000:00010000:0.0:1788865010.535148:0:15701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044e00/0xf8c13e2d0e95a1db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a1e2 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788865010.535408:0:15701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546672768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788865010.535453:0:15701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788865010.535499:0:15701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca150b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788865010.535566:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546672768 00000100:00100000:3.0:1788865010.535572:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546672768 00000100:00100000:3.0:1788865010.535620:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788865010.535629:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:15701:x1875760546672768:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788865010.536572:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:15701:x1875760546672768:12345-0@lo:501:mount.lustre.0 Request processed in 942us (1116us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788865010.536582:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788865010.538180:0:15701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546672768:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788865010.538238:0:15701:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788865010.538500:0:15701:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788865010.538509:0:15701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044e00/0xf8c13e2d0e95a1db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a1e2 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.538520:0:15701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdcc2044e00/0xf8c13e2d0e95a1db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a1e2 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788865010.538547:0:15701:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fdc82ac3800 10000000:01000000:0.0:1788865010.538551:0:15701:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788865010.538556:0:15701:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788865010.538559:0:15701:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788865010.538563:0:15701:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788865010.538566:0:15701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788865010.538596:0:15701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc05bd000/0xf8c13e2d0e95a435 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.538604:0:15701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdcc05bd000/0xf8c13e2d0e95a435 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.538613:0:15701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdcc05bd000/0xf8c13e2d0e95a435 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788865010.538632:0:15701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546672896:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788865010.538683:0:15701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788865010.539438:0:15701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca150b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788865010.541674:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546672896 00000100:00100000:3.0:1788865010.541689:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546672896 00000100:00100000:3.0:1788865010.541813:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788865010.541825:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:15701:x1875760546672896:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788865010.542121:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788865010.542140:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e95a43c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95a435 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865010.542170:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e95a43c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a435 expref: 17 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865010.542182:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcc2044600/0xf8c13e2d0e95a43c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a435 expref: 17 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865010.542191:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcc2044600, rc 0) 00000100:00100000:3.0:1788865010.542300:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+17:15701:x1875760546672896:12345-0@lo:101:mount.lustre.0 Request processed in 478us (3616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865010.542307:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788865010.542497:0:15701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546672896:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788865010.542517:0:15701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdcc05bd000/0xf8c13e2d0e95a435 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a43c expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865010.542526:0:15701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdcc05bd000/0xf8c13e2d0e95a435 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95a43c expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788865010.543272:0:15701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788865010.544333:0:15701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788865010.544594:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788865010.544640:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788865010.544676:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788865010.544771:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788865010.544806:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788865010.544855:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788865010.544921:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788865010.544929:0:15701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788865010.545011:0:15701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546673024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788865010.545070:0:15701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788865010.545116:0:15701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc85e95480 going to sleep for 11 seconds 00000100:00100000:2.0:1788865010.545245:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546673024 00000100:00100000:2.0:1788865010.545252:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546673024 00000100:00100000:2.0:1788865010.545294:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788865010.545304:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+17:15701:x1875760546673024:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788865010.545881:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+17:15701:x1875760546673024:12345-0@lo:501:mount.lustre.0 Request processed in 578us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865010.545890:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788865010.547606:0:15701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546673024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788865010.547662:0:15701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546673152:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788865010.549431:0:15701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788865010.549478:0:15701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc85e95480 going to sleep for 11 seconds 00000100:00100000:3.0:1788865010.549529:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546673152 00000100:00100000:3.0:1788865010.549539:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546673152 00000100:00100000:3.0:1788865010.549596:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788865010.549605:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+17:15701:x1875760546673152:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788865010.549995:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+17:15701:x1875760546673152:12345-0@lo:503:mount.lustre.0 Request processed in 390us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865010.550003:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788865010.550597:0:15701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546673152:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788865010.551278:0:15701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788865010.551376:0:15701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546673280:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788865010.551433:0:15701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788865010.551463:0:15701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc85e95480 going to sleep for 11 seconds 00000100:00100000:0.0:1788865010.551549:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546673280 00000100:00100000:0.0:1788865010.551555:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546673280 00000100:00100000:0.0:1788865010.551600:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788865010.551617:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+17:15701:x1875760546673280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788865010.551867:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+17:15701:x1875760546673280:12345-0@lo:502:mount.lustre.0 Request processed in 252us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865010.551874:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788865010.552059:0:15701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546673280:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788865010.552302:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788865010.552350:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788865010.552383:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788865010.552446:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788865010.552485:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788865010.552517:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788865010.552576:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788865010.552613:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788865010.552662:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788865010.552691:0:15701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546673408:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788865010.553357:0:15701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788865010.553406:0:15701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc85e95480 going to sleep for 11 seconds 00000100:00100000:2.0:1788865010.554556:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546673408 00000100:00100000:2.0:1788865010.554566:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546673408 00000100:00100000:2.0:1788865010.554618:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788865010.554626:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+17:15701:x1875760546673408:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788865010.554890:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+17:15701:x1875760546673408:12345-0@lo:502:mount.lustre.0 Request processed in 263us (1533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865010.554897:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788865010.555027:0:15701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546673408:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788865010.555139:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788865010.555153:0:15701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788865010.564551:0:15702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788865010.564564:0:15702:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788865010.564572:0:15702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788865010.564574:0:15702:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788865010.564580:0:15702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788865010.564594:0:15702:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9fdc9f64b380) 00000020:00000080:1.0:1788865010.564622:0:15702:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788865010.564627:0:15702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788865010.564764:0:15702:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fdc82ac3800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788865010.564771:0:15702:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788865010.564779:0:15702:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf8c13e2d0e95a44a 00010000:00010000:1.0:1788865010.574058:0:15702:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788865010.575275:0:15702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1788865010.582336:0:15702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788865010.586858:0:15702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788865010.586883:0:15702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788865010.586890:0:15702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788865010.586893:0:15702:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788865010.586897:0:15702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788865010.586911:0:15702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788865010.586912:0:15702:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788865010.586922:0:15702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788865010.586925:0:15702:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788865010.586930:0:15702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788865010.586932:0:15702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788865010.586933:0:15702:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788865010.586935:0:15702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788865010.586937:0:15702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788865010.586939:0:15702:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788865010.586943:0:15702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788865010.587004:0:15702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788865010.587008:0:15702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788865010.587010:0:15702:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788865010.587013:0:15702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788865010.588419:0:15701:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788865010.588454:0:15701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788865010.588477:0:15701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc05bd000/0xf8c13e2d0e95a435 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a43c expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865010.588490:0:15701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdcc05bd000/0xf8c13e2d0e95a435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a43c expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788865010.588499:0:15701:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fdc82ac3800 from 1 10000000:01000000:1.0:1788865010.588502:0:15701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788865010.588539:0:15701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcafc74600/0xf8c13e2d0e95a451 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865010.588559:0:15701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdcafc74600/0xf8c13e2d0e95a451 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865010.588571:0:15701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdcafc74600/0xf8c13e2d0e95a451 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788865010.588596:0:15701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546673536:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788865010.588656:0:15701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788865010.588688:0:15701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc85e95600 going to sleep for 11 seconds 00000100:00100000:3.0:1788865010.588888:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546673536 00000100:00100000:3.0:1788865010.588902:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546673536 00000100:00100000:3.0:1788865010.588958:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788865010.588968:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+17:15701:x1875760546673536:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788865010.588982:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788865010.588994:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcc2045600/0xf8c13e2d0e95a458 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95a451 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865010.589020:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcc2045600/0xf8c13e2d0e95a458 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a451 expref: 18 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865010.589031:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcc2045600/0xf8c13e2d0e95a458 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a451 expref: 18 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865010.589040:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcc2045600, rc 0) 00000100:00100000:3.0:1788865010.589080:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+18:15701:x1875760546673536:12345-0@lo:101:mount.lustre.0 Request processed in 114us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865010.589087:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788865010.589652:0:15701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546673536:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788865010.589667:0:15701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdcafc74600/0xf8c13e2d0e95a451 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a458 expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865010.589677:0:15701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdcafc74600/0xf8c13e2d0e95a451 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95a458 expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788865010.590326:0:15701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788865010.590613:0:15701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788865010.590970:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788865010.591019:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788865010.591085:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788865010.591093:0:15701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788865010.591304:0:15701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546673664:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788865010.591360:0:15701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788865010.591397:0:15701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc85e95600 going to sleep for 11 seconds 00000100:00100000:1.0:1788865010.591423:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546673664 00000100:00100000:1.0:1788865010.591430:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546673664 00000100:00100000:1.0:1788865010.591472:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788865010.591480:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+18:15701:x1875760546673664:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788865010.591677:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+18:15701:x1875760546673664:12345-0@lo:501:mount.lustre.0 Request processed in 196us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865010.591685:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788865010.592844:0:15701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546673664:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788865010.592884:0:15701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546673792:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788865010.592938:0:15701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788865010.592967:0:15701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc85e95600 going to sleep for 11 seconds 00000100:00100000:1.0:1788865010.592984:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546673792 00000100:00100000:1.0:1788865010.592989:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546673792 00000100:00100000:1.0:1788865010.593015:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788865010.593022:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+18:15701:x1875760546673792:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788865010.596925:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+18:15701:x1875760546673792:12345-0@lo:503:mount.lustre.0 Request processed in 3893us (3976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865010.596940:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788865010.597122:0:15701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546673792:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788865010.598092:0:15701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788865010.598167:0:15701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546673920:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788865010.598233:0:15701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788865010.598270:0:15701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc83305600 going to sleep for 11 seconds 00000100:00100000:2.0:1788865010.598749:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546673920 00000100:00100000:2.0:1788865010.598757:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546673920 00000100:00100000:2.0:1788865010.598800:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788865010.598809:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+18:15701:x1875760546673920:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788865010.598999:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+18:15701:x1875760546673920:12345-0@lo:502:mount.lustre.0 Request processed in 191us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865010.599014:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788865010.599325:0:15701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546673920:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788865010.599584:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788865010.599629:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788865010.599669:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788865010.599699:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788865010.599836:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788865010.599886:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788865010.599933:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788865010.599966:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788865010.600003:0:15701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546674048:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788865010.600052:0:15701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788865010.600076:0:15701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc83305600 going to sleep for 11 seconds 00000100:00100000:0.0:1788865010.600154:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546674048 00000100:00100000:0.0:1788865010.600160:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546674048 00000100:00100000:0.0:1788865010.600203:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788865010.600212:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+18:15701:x1875760546674048:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788865010.600376:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+18:15701:x1875760546674048:12345-0@lo:502:mount.lustre.0 Request processed in 165us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865010.600383:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788865010.600528:0:15701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546674048:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788865010.600612:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788865010.600622:0:15701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788865010.602464:0:15706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788865010.602477:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788865010.602479:0:15706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788865010.602485:0:15706:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fdc82ac3800 00000020:00000080:2.0:1788865010.602489:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788865010.602496:0:15706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788865010.602498:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788865010.602500:0:15706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788865010.602502:0:15706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788865010.602504:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788865010.602505:0:15706:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788865010.602507:0:15706:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fdc82ac3800 00000020:00000080:2.0:1788865010.602509:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788865010.602599:0:15706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788865010.602603:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788865010.602605:0:15706:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788865010.602608:0:15706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788865010.602610:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788865010.602611:0:15706:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788865010.602614:0:15706:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fdc82ac3800 00000020:00000080:2.0:1788865010.602616:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788865010.605985:0:15706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788865010.605998:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788865010.606000:0:15706:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788865010.606005:0:15706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788865010.606226:0:15701:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788865010.606254:0:15701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788865010.606275:0:15701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcafc74600/0xf8c13e2d0e95a451 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a458 expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865010.606287:0:15701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdcafc74600/0xf8c13e2d0e95a451 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a458 expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788865010.606334:0:15701:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788865010.606337:0:15701:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fdc82ac3800 10000000:01000000:1.0:1788865010.606340:0:15701:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fdc82ac3800 10000000:01000000:1.0:1788865010.606344:0:15701:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788865010.606349:0:15701:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fdc82ac3800 from 1 10000000:01000000:1.0:1788865010.606352:0:15701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788865010.606388:0:15701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75000/0xf8c13e2d0e95a45f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865010.606396:0:15701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75000/0xf8c13e2d0e95a45f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865010.606408:0:15701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75000/0xf8c13e2d0e95a45f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788865010.606447:0:15701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546674176:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788865010.606509:0:15701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788865010.613514:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546674176 00000100:00100000:0.0:1788865010.613528:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546674176 00000100:00100000:0.0:1788865010.613575:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788865010.613584:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+18:15701:x1875760546674176:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788865010.613599:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788865010.613616:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcc05bda00/0xf8c13e2d0e95a466 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95a45f expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.613643:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcc05bda00/0xf8c13e2d0e95a466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a45f expref: 19 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.613653:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcc05bda00/0xf8c13e2d0e95a466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a45f expref: 19 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.613674:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcc05bda00, rc 0) 00000100:00100000:0.0:1788865010.613794:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:15701:x1875760546674176:12345-0@lo:101:mount.lustre.0 Request processed in 211us (7285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865010.613801:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788865010.617005:0:15701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc83305480 going to sleep for 11 seconds 00000100:00100000:2.0:1788865010.617044:0:15701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546674176:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788865010.617069:0:15701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75000/0xf8c13e2d0e95a45f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a466 expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865010.617091:0:15701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75000/0xf8c13e2d0e95a45f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95a466 expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788865010.618442:0:15701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788865010.622007:0:15701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788865010.624390:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788865010.624473:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788865010.624512:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788865010.624581:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788865010.624619:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788865010.624669:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788865010.624741:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788865010.624780:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788865010.624831:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788865010.624867:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788865010.624902:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788865010.624954:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788865010.624993:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788865010.625029:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788865010.625078:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788865010.625259:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788865010.625296:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788865010.625348:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788865010.625384:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788865010.625437:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788865010.625490:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788865010.625530:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788865010.625563:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788865010.625621:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788865010.625654:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788865010.625683:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788865010.627224:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788865010.627275:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788865010.627310:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788865010.627357:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1788865010.627392:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1788865010.627423:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1788865010.627453:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1788865010.627501:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1788865010.627538:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1788865010.627613:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1788865010.627652:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1788865010.629004:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1788865010.629018:0:15701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788865010.629192:0:15701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546674304:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788865010.629263:0:15701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788865010.629336:0:15701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1fd03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788865010.631282:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546674304 00000100:00100000:3.0:1788865010.631294:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546674304 00000100:00100000:3.0:1788865010.631388:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788865010.631398:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcb7ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:15701:x1875760546674304:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788865010.631680:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcb7ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:15701:x1875760546674304:12345-0@lo:501:mount.lustre.0 Request processed in 283us (2416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865010.631689:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788865010.635357:0:15701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546674304:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788865010.635422:0:15701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546674432:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788865010.635496:0:15701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788865010.635650:0:15701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1fd03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788865010.635862:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546674432 00000100:00100000:1.0:1788865010.635869:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546674432 00000100:00100000:1.0:1788865010.635910:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788865010.635919:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:15701:x1875760546674432:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788865010.636219:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:15701:x1875760546674432:12345-0@lo:503:mount.lustre.0 Request processed in 301us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865010.636227:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788865010.636375:0:15701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546674432:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788865010.636971:0:15701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788865010.637040:0:15701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546674560:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788865010.637091:0:15701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788865010.637107:0:15701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1fd03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788865010.637242:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546674560 00000100:00100000:1.0:1788865010.637247:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546674560 00000100:00100000:1.0:1788865010.637271:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788865010.637277:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:15701:x1875760546674560:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788865010.637573:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:15701:x1875760546674560:12345-0@lo:502:mount.lustre.0 Request processed in 294us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865010.637581:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788865010.644016:0:15701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546674560:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788865010.644448:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788865010.644501:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788865010.644527:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788865010.644589:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788865010.644619:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788865010.644657:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788865010.644684:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788865010.644944:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788865010.645000:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788865010.645030:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788865010.645056:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788865010.645180:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788865010.645228:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788865010.645256:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788865010.645296:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788865010.645325:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788865010.645351:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788865010.645390:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788865010.645420:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788865010.645461:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788865010.645500:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788865010.645528:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788865010.645554:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788865010.645590:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788865010.645617:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788865010.645643:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788865010.645690:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788865010.647483:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788865010.647533:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788865010.647602:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788865010.647641:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788865010.647674:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788865010.647961:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788865010.648024:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788865010.648063:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788865010.648237:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788865010.648280:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788865010.648315:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788865010.648368:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788865010.648408:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788865010.648459:0:15701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546674688:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788865010.648539:0:15701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788865010.648630:0:15701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca150b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788865010.648671:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546674688 00000100:00100000:1.0:1788865010.648679:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546674688 00000100:00100000:1.0:1788865010.649267:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788865010.649279:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:15701:x1875760546674688:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788865010.649552:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:15701:x1875760546674688:12345-0@lo:502:mount.lustre.0 Request processed in 276us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865010.649559:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788865010.649902:0:15701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546674688:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788865010.649996:0:15701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788865010.650008:0:15701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788865010.651004:0:15711:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788865010.651018:0:15711:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9fdca14c99c0) 00000020:00000080:0.0:1788865010.651036:0:15711:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788865010.651107:0:15711:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fdc82ac3800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788865010.651163:0:15711:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fdc82ac3800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788865010.651167:0:15711:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fdc82ac3800 3 00010000:00080000:0.0:1788865010.651202:0:15711:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fdcc0034000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.113@tcp at head 00010000:00010000:0.0:1788865010.656686:0:15711:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1788865010.657123:0:15711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788865010.657159:0:15711:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788865010.657181:0:15711:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf8c13e2d0e95a474 00000100:00080000:0.0:1788865010.657191:0:15711:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788865010.657211:0:15711:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fdcc0034000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1788865010.657245:0:15711:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fdc9f45f100 x1875760546674816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788865010.657275:0:15711:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788865010.657409:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875760546674816:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788865010.657481:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788865010.657580:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546674816 00000100:00100000:0.0:1788865010.657588:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546674816 00000100:00100000:0.0:1788865010.657628:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788865010.657636:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1875760546674816:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788865010.657659:0:14303:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 433 last 0 00000020:00000080:0.0:1788865010.657685:0:14303:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf8c13e2d0e95a47b 00000004:00100000:0.0:1788865010.657699:0:14303:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788865010.657854:0:14303:0:(import.c:65:import_set_state_nolock()) ffff9fdb819b4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788865010.657940:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875760546674816:12345-0@lo:38:llog_process_th.0 Request processed in 303us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865010.657947:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788865010.659678:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788865010.659689:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788865010.659692:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fdc83524000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788865010.659698:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 432 00000100:00080000:2.0:1788865010.659720:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788865010.661687:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fdc83524000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788865010.661789:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fdcac9cca80 x1875760546675072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788865010.661870:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546674944:0@lo:400:kworker.0 00000100:00100000:2.0:1788865010.661932:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788865010.661969:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788865010.661976:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546675200:0@lo:400:kworker.0 00000100:00100000:2.0:1788865010.662000:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788865010.662033:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546675200 00000100:00100000:2.0:1788865010.662040:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546675200 00000100:00100000:2.0:1788865010.662083:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788865010.662092:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546675200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788865010.662237:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788865010.662247:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875760546675328:0@lo:400:kworker.0 00000100:00100000:3.0:1788865010.662275:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788865010.662312:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546674944 00000100:00100000:3.0:1788865010.662323:0:14983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546674944 00000100:00100000:3.0:1788865010.662355:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788865010.662362:0:14983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3300:x1875760546674944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788865010.662401:0:14983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3300:x1875760546674944:12345-0@lo:400:kworker.0 Request processed in 40us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865010.662407:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788865010.662436:0:14303:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788865010.662444:0:14303:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788865010.662473:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546674944:0@lo:400:kworker.0 00000100:00100000:2.0:1788865010.662585:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875760546675200:12345-0@lo:400:kworker.0 Request processed in 494us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865010.662592:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788865010.662606:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546675328 00000100:00100000:2.0:1788865010.662609:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546675328 00000100:00100000:2.0:1788865010.662624:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788865010.662629:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875760546675328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788865010.662662:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875760546675328:12345-0@lo:400:kworker.0 Request processed in 32us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865010.662669:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788865010.664217:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdc9f45f100 x1875760546674816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788865020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788865010.664231:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788865010.664241:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788865010.664250:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788865010.664256:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788865010.664260:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fdcc0034000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788865010.664268:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875760546674816:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788865010.664846:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875760546675072:0@lo:8:kworker.0 00000100:00100000:0.0:1788865010.664910:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788865010.666075:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdcac9cf480 x1875760546675200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788865026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788865010.666089:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875760546675200:0@lo:400:kworker.0 00010000:00080000:3.0:1788865010.666138:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fdcac9cea00 x1875760546675328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788865026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788865010.666147:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875760546675328:0@lo:400:kworker.0 00000100:00100000:2.0:1788865010.666899:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546675072 00000100:00100000:2.0:1788865010.666907:0:14986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546675072 00000100:00100000:2.0:1788865010.666945:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788865010.666954:0:14986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3299:x1875760546675072:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788865010.667040:0:14986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3299:x1875760546675072:12345-0@lo:8:kworker.0 Request processed in 85us (2130us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788865010.667048:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788865010.667092:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788865010.667098:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fdc83524000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788865010.667103:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788865010.667107:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875760546675072:0@lo:8:kworker.0 00000040:00080000:0.0:1788865010.667439:0:15711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788865010.667594:0:15701:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788865010.667617:0:15701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788865010.667638:0:15701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75000/0xf8c13e2d0e95a45f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a466 expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865010.667649:0:15701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75000/0xf8c13e2d0e95a45f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a466 expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788865010.667696:0:15701:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788865010.667699:0:15701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788865010.667700:0:15701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788865010.667831:0:15701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788865010.667833:0:15701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788865010.667834:0:15701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788865010.667836:0:15701:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788865010.667837:0:15701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788865010.667839:0:15701:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788865010.667843:0:15701:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788865010.667845:0:15701:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788865010.667847:0:15701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788865010.667848:0:15701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788865010.667854:0:15701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788865010.667855:0:15701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788865010.667856:0:15701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788865010.667856:0:15701:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788865010.667857:0:15701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788865010.667858:0:15701:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788865010.667879:0:15701:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788865010.667898:0:15701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546675456:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788865010.667959:0:15701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788865010.667993:0:15701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1fd0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788865010.668090:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546675456 00000100:00100000:0.0:1788865010.668096:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546675456 00000100:00100000:0.0:1788865010.668212:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788865010.668222:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:15701:x1875760546675456:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788865010.668245:0:14293:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788865010.668258:0:14293:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788865010.693259:0:14293:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788865010.693274:0:14293:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788865010.693319:0:14317:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788865010.693336:0:14317:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788865010.693356:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fdcc05bd200/0xf8c13e2d0e95a482 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.693375:0:14317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdca2d4b000/0xf8c13e2d0e95a35c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a355 expref: 19 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.693384:0:14317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fdcc05bd200/0xf8c13e2d0e95a482 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.693423:0:14317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdca2d4b000/0xf8c13e2d0e95a35c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e95a355 expref: 19 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.693438:0:14317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fdca2d4b000/0xf8c13e2d0e95a35c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a355 expref: 19 pid: 14295 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788865010.693451:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14317:1875760546675584:0@lo:104: 00000100:00100000:0.0:1788865010.693512:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788865010.693560:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca04dcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788865010.693815:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546675584 00000100:00100000:1.0:1788865010.693823:0:14285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546675584 00000100:00100000:1.0:1788865010.693861:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788865010.693868:0:14285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+3:14317:x1875760546675584:12345-0@lo:104: 00010000:00010000:1.0:1788865010.693881:0:14285:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75800/0xf8c13e2d0e95a355 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e95a35c expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865010.693927:0:14285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788865010.693933:0:14285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+3:14317:x1875760546675584:12345-0@lo:104: Request processed in 65us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865010.693939:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788865010.694302:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14317:1875760546675584:0@lo:104: 00010000:00010000:0.0:1788865010.694323:0:14317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fdcc05bd200/0xf8c13e2d0e95a482 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.694341:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788865010.694346:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75800/0xf8c13e2d0e95a355 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e95a35c expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.694353:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75800 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:0.0:1788865010.694357:0:14289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75800/0xf8c13e2d0e95a355 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e95a35c expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.694380:0:14289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75800/0xf8c13e2d0e95a355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e95a35c expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788865010.694388:0:14289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75800/0xf8c13e2d0e95a355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e95a35c expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788865010.694394:0:14289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788865010.694424:0:14289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75800/0xf8c13e2d0e95a355 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95a35c expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.694431:0:14289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788865010.694449:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75800/0xf8c13e2d0e95a355 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95a35c expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.694456:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75800/0xf8c13e2d0e95a355 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95a35c expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.694471:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865010.694473:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865010.694475:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788865010.694493:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3303:1875760546675712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788865010.694528:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788865010.694572:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546675712 00000100:00100000:0.0:1788865010.694577:0:14287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546675712 00010000:00010000:0.0:1788865010.694595:0:14287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdca2d4b000/0xf8c13e2d0e95a35c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a355 expref: 20 pid: 14295 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788865010.694617:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788865010.694624:0:14287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+20:3303:x1875760546675712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788865010.694642:0:14287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788865010.694648:0:14287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdca2d4b000/0xf8c13e2d0e95a35c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a355 expref: 20 pid: 14295 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.694657:0:14287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdca2d4b000/0xf8c13e2d0e95a35c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a355 expref: 20 pid: 14295 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.694669:0:14287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdca2d4b000/0xf8c13e2d0e95a35c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e95a355 expref: 20 pid: 14295 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.694682:0:14287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fdcc05bd200/0xf8c13e2d0e95a482 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.694691:0:14287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcc05bd200/0xf8c13e2d0e95a482 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788865010.694911:0:14287:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001575381s 00010000:00010000:0.0:1788865010.694916:0:14287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fdcc05bd200/0xf8c13e2d0e95a482 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.694924:0:14287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fdcc05bd200/0xf8c13e2d0e95a482 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.694932:0:14287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fdcc05bd200/0xf8c13e2d0e95a482 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.694938:0:14287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fdcc05bd200/0xf8c13e2d0e95a482 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.694943:0:14287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc05bd200 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788865010.694947:0:14287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fdcc05bd200/0xf8c13e2d0e95a482 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.694960:0:14287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fdcc05bd200/0xf8c13e2d0e95a482 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.694973:0:14287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fdcc05bd200/0xf8c13e2d0e95a482 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.694983:0:14287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788865010.695012:0:14287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:3303:x1875760546675712:12345-0@lo:103:ldlm_bl.0 Request processed in 389us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865010.695019:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788865010.695041:0:14317:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fdcc05bd200/0xf8c13e2d0e95a482 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.695049:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fdcc05bd200/0xf8c13e2d0e95a482 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865010.695055:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcc05bd200/0xf8c13e2d0e95a482 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788865010.695077:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3303:1875760546675712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788865010.703346:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+18:15701:x1875760546675456:12345-0@lo:253:mount.lustre.0 Request processed in 35119us (35379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865010.703361:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788865010.703519:0:15701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:15701:1875760546675456:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788865010.703537:0:15701:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788865010.703540:0:15701:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788865010.703541:0:15701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788865010.703543:0:15701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788865010.703544:0:15701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788865010.703545:0:15701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788865010.703546:0:15701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788865010.703548:0:15701:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788865010.703550:0:15701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788865010.703551:0:15701:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788865010.703565:0:15701:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788865010.709247:0:15701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788865010.709397:0:15701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788865010.709604:0:15701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788865010.709966:0:15701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788865010.710104:0:15701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788865010.710391:0:15701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788865010.711393:0:15701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788865010.758611:0:15701:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788865010.758619:0:15701:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788865010.758652:0:15701:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788865010.758919:0:15701:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788865010.758937:0:15701:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788865010.758963:0:15701:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788865011.091074:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865012.103058:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788865012.293778:0:14298:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788865012.293785:0:14298:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fdb812fc800 from 8 10000000:01000000:0.0:1788865012.293790:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788865012.293839:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc05bde00/0xf8c13e2d0e95a489 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865012.293872:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdcc05bde00/0xf8c13e2d0e95a489 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865012.293883:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdcc05bde00/0xf8c13e2d0e95a489 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788865012.293920:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546675840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788865012.294000:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788865012.294064:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca8d28900 going to sleep for 11 seconds 00000100:00100000:1.0:1788865012.294445:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546675840 00000100:00100000:1.0:1788865012.294454:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546675840 00000100:00100000:1.0:1788865012.294560:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788865012.294569:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+18:14298:x1875760546675840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788865012.294592:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788865012.294735:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcb5385200/0xf8c13e2d0e95a490 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95a489 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865012.294762:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcb5385200/0xf8c13e2d0e95a490 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a489 expref: 19 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865012.294773:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcb5385200/0xf8c13e2d0e95a490 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a489 expref: 19 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865012.294789:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385200, rc 0) 00000100:00100000:2.0:1788865012.295233:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:14298:x1875760546675840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 664us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865012.295241:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788865012.295356:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546675840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788865012.295373:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdcc05bde00/0xf8c13e2d0e95a489 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a490 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865012.295382:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdcc05bde00/0xf8c13e2d0e95a489 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95a490 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788865012.295433:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81927100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546675968:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788865012.295465:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788865012.295521:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca8c0b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788865012.295549:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546675968 00000100:00100000:2.0:1788865012.295553:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546675968 00000100:00100000:2.0:1788865012.295574:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788865012.295580:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:14298:x1875760546675968:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788865012.295593:0:14293:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788865012.295607:0:14293:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788865012.295610:0:14293:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788865012.296103:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:14298:x1875760546675968:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 521us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865012.296111:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788865012.296227:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81927100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546675968:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788865012.296356:0:14298:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788865012.296364:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcc05bde00/0xf8c13e2d0e95a489 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a490 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865012.296373:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdcc05bde00/0xf8c13e2d0e95a489 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a490 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865013.129278:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788865013.135626:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788865013.135648:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788865014.150466:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788865015.109829:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788865015.109849:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546676096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788865015.109913:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788865015.109978:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546676096 00000100:00100000:1.0:1788865015.109988:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546676096 00000100:00080000:2.0:1788865015.110047:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788865015.110054:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788865015.110065:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546676096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788865015.110096:0:14987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788865015.110144:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546676096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865015.110162:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788865015.110185:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788865015.110204:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546676096:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788865015.172859:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788865016.139634:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788865016.140220:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86ebbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3301:1875760546676224:0@lo:400:kworker.0 00000100:00080000:3.0:1788865016.140282:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788865016.140287:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fdc83524000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788865016.140291:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788865016.140303:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fdc83524000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788865016.140327:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fdc86eb8a80 x1875760546676480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788865016.140392:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546676736:0@lo:400:kworker.0 00000100:00100000:2.0:1788865016.140416:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546676224 00000100:00100000:2.0:1788865016.140426:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546676224 00000100:00100000:3.0:1788865016.140502:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788865016.140509:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788865016.140520:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:3301:x1875760546676224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788865016.140532:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788865016.140541:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546676864:0@lo:400:kworker.0 00000100:00100000:2.0:1788865016.140575:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:3301:x1875760546676224:12345-0@lo:400:kworker.0 Request processed in 57us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865016.140580:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788865016.140593:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788865016.140613:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546676352:0@lo:400:kworker.0 00000100:00100000:3.0:1788865016.140653:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788865016.140684:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788865016.140692:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546676608:0@lo:400:kworker.0 00000100:00100000:0.0:1788865016.140754:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546676352 00000100:00100000:3.0:1788865016.140756:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788865016.140761:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546676352 00000100:00100000:3.0:1788865016.140798:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875760546676480:0@lo:8:kworker.0 00000100:00100000:3.0:1788865016.140824:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788865016.140929:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546676736 00000100:00100000:1.0:1788865016.140935:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546676736 00000100:00100000:1.0:1788865016.140968:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546676864 00000100:00100000:1.0:1788865016.140971:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546676864 00000100:00100000:1.0:1788865016.140981:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546676608 00000100:00100000:1.0:1788865016.140983:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546676608 00000100:00100000:1.0:1788865016.140994:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788865016.141000:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546676736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788865016.141039:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546676736:12345-0@lo:400:kworker.0 Request processed in 39us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865016.141045:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788865016.141062:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788865016.141068:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546676864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788865016.141092:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546676864:12345-0@lo:400:kworker.0 Request processed in 25us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865016.141097:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788865016.141107:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788865016.141113:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546676608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788865016.141143:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546676608:12345-0@lo:400:kworker.0 Request processed in 30us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865016.141150:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788865016.141560:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788865016.142121:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546676480 00000100:00100000:0.0:1788865016.142128:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546676480 00000100:00100000:3.0:1788865016.142133:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788865016.142145:0:14983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546676352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788865016.142191:0:14985:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788865016.142200:0:14983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546676352:12345-0@lo:400:kworker.0 Request processed in 59us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865016.142201:0:14985:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788865016.142210:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788865016.142234:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788865016.142238:0:14983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1875760546676480:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788865016.142263:0:14983:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:3.0:1788865016.142303:0:14983:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf8c13e2d0e95a497 00002000:00100000:3.0:1788865016.142316:0:14983:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9fdb82ca2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788865016.142320:0:14983:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788865016.142323:0:14983:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788865016.143192:0:14983:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788865016.143264:0:14983:0:(import.c:65:import_set_state_nolock()) ffff9fdb82ca0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788865016.143331:0:14983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1875760546676480:12345-0@lo:8:kworker.0 Request processed in 1091us (2507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865016.143341:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788865016.143406:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86ebbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3301:1875760546676224:0@lo:400:kworker.0 00010000:00080000:3.0:1788865016.143449:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc86eb9f80 x1875760546676608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788865032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788865016.143462:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546676608:0@lo:400:kworker.0 00000100:00100000:3.0:1788865016.143477:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546676352:0@lo:400:kworker.0 00010000:00080000:3.0:1788865016.143689:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc86eb9c00 x1875760546676864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788865032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788865016.143722:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546676864:0@lo:400:kworker.0 00010000:00080000:3.0:1788865016.143749:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc86ebb100 x1875760546676736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788865032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788865016.143755:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdc86eb8a80 x1875760546676480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788865041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788865016.143763:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546676736:0@lo:400:kworker.0 00000100:00080000:0.0:1788865016.143777:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788865016.143785:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788865016.143790:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788865016.143792:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fdc83524000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788865016.143809:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788865016.143813:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875760546676480:0@lo:8:kworker.0 00000004:00080000:3.0:1788865016.143910:0:14325:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788865016.143924:0:14326:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1788865016.143946:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81927800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14326:1875760546677120:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788865016.143982:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788865016.144001:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1fd0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788865016.144074:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546677120 00000100:00100000:0.0:1788865016.144085:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546677120 00000100:00100000:0.0:1788865016.144142:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788865016.144152:0:14985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14326:x1875760546677120:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788865016.144491:0:14325:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 439275775872ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788865016.145200:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788865016.145297:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546676992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788865016.145342:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788865016.145459:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546676992 00000100:00100000:1.0:1788865016.145466:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546676992 00000100:00100000:1.0:1788865016.145502:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788865016.145510:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875760546676992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788865016.145536:0:14987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788865016.145582:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875760546676992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865016.145589:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788865016.145816:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fdb81927100 x1875760546676992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788865032 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788865016.146012:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546676992:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788865016.147127:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1788865016.150857:0:14985:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788865016.150869:0:14985:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788865016.150874:0:14985:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:0.0:1788865016.166472:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.166485:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a84a662/0xf8c13e2d0e95a49e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.166503:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.166508:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.166514:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a84a662/0xf8c13e2d0e95a49e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.166531:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a84a662/0xf8c13e2d0e95a49e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.166541:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a84a662/0xf8c13e2d0e95a49e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.166549:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a84a662/0xf8c13e2d0e95a49e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.166574:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788865016.166623:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788865016.166632:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a84a662/0xf8c13e2d0e95a49e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865016.166643:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc05bc200 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:3.0:1788865016.166648:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a84a662/0xf8c13e2d0e95a49e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865016.166659:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a84a662/0xf8c13e2d0e95a49e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865016.166680:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a84a662/0xf8c13e2d0e95a49e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865016.166689:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a84a662/0xf8c13e2d0e95a49e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865016.166726:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788865016.166729:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788865016.166731:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865016.166999:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.167006:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ae877f4/0xf8c13e2d0e95a4a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.167019:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.167022:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.167027:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ae877f4/0xf8c13e2d0e95a4a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.167037:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ae877f4/0xf8c13e2d0e95a4a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.167045:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ae877f4/0xf8c13e2d0e95a4a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.167052:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ae877f4/0xf8c13e2d0e95a4a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.167066:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788865016.167075:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788865016.167079:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ae877f4/0xf8c13e2d0e95a4a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.167086:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc05bd800 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788865016.167089:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ae877f4/0xf8c13e2d0e95a4a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.167096:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ae877f4/0xf8c13e2d0e95a4a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.167118:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ae877f4/0xf8c13e2d0e95a4a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.167126:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ae877f4/0xf8c13e2d0e95a4a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.167140:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865016.167141:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865016.167143:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865016.168030:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.168038:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f166b03/0xf8c13e2d0e95a4ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.168050:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.168053:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.168058:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f166b03/0xf8c13e2d0e95a4ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.168069:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f166b03/0xf8c13e2d0e95a4ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.168076:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f166b03/0xf8c13e2d0e95a4ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.168084:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f166b03/0xf8c13e2d0e95a4ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.168118:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788865016.168191:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788865016.168198:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f166b03/0xf8c13e2d0e95a4ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865016.168215:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc05bcc00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:3.0:1788865016.168219:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f166b03/0xf8c13e2d0e95a4ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865016.168229:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f166b03/0xf8c13e2d0e95a4ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865016.168246:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f166b03/0xf8c13e2d0e95a4ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865016.168253:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f166b03/0xf8c13e2d0e95a4ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865016.168272:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788865016.168274:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788865016.168276:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865016.168488:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.168492:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a162b1f1/0xf8c13e2d0e95a4b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.168499:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.168501:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.168503:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a162b1f1/0xf8c13e2d0e95a4b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.168509:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a162b1f1/0xf8c13e2d0e95a4b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.168514:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a162b1f1/0xf8c13e2d0e95a4b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.168519:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a162b1f1/0xf8c13e2d0e95a4b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.168528:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788865016.168534:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788865016.168536:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a162b1f1/0xf8c13e2d0e95a4b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.168540:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc05bdc00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788865016.168546:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a162b1f1/0xf8c13e2d0e95a4b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.168552:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a162b1f1/0xf8c13e2d0e95a4b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.168560:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a162b1f1/0xf8c13e2d0e95a4b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.168565:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a162b1f1/0xf8c13e2d0e95a4b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.168573:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865016.168574:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865016.168575:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865016.168845:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.168849:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ead771e2/0xf8c13e2d0e95a4ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.168855:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.168857:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.168860:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ead771e2/0xf8c13e2d0e95a4ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.168866:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ead771e2/0xf8c13e2d0e95a4ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.168871:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ead771e2/0xf8c13e2d0e95a4ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.168880:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ead771e2/0xf8c13e2d0e95a4ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.168896:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788865016.169067:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788865016.169073:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ead771e2/0xf8c13e2d0e95a4ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865016.169080:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc05bc800 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:3.0:1788865016.169084:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ead771e2/0xf8c13e2d0e95a4ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865016.169093:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ead771e2/0xf8c13e2d0e95a4ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865016.169113:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ead771e2/0xf8c13e2d0e95a4ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865016.169120:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ead771e2/0xf8c13e2d0e95a4ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865016.169137:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788865016.169139:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788865016.169142:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865016.169245:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.169251:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001906964e/0xf8c13e2d0e95a4c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.169259:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.169262:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.169266:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001906964e/0xf8c13e2d0e95a4c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.169275:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001906964e/0xf8c13e2d0e95a4c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.169283:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001906964e/0xf8c13e2d0e95a4c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.169290:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001906964e/0xf8c13e2d0e95a4c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.169304:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788865016.169313:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788865016.169316:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001906964e/0xf8c13e2d0e95a4c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.169330:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc05bca00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788865016.169333:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001906964e/0xf8c13e2d0e95a4c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.169342:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001906964e/0xf8c13e2d0e95a4c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.169353:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001906964e/0xf8c13e2d0e95a4c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.169360:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001906964e/0xf8c13e2d0e95a4c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.169373:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865016.169375:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865016.169377:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865016.169641:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.169646:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033b95fe4/0xf8c13e2d0e95a4c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.169652:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.169654:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.169656:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033b95fe4/0xf8c13e2d0e95a4c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.169662:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033b95fe4/0xf8c13e2d0e95a4c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.169672:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033b95fe4/0xf8c13e2d0e95a4c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.169676:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033b95fe4/0xf8c13e2d0e95a4c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.169691:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788865016.169745:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788865016.169751:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033b95fe4/0xf8c13e2d0e95a4c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865016.169759:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc05bc600 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:3.0:1788865016.169763:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033b95fe4/0xf8c13e2d0e95a4c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865016.169773:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033b95fe4/0xf8c13e2d0e95a4c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865016.169787:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033b95fe4/0xf8c13e2d0e95a4c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865016.169793:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033b95fe4/0xf8c13e2d0e95a4c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865016.169825:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788865016.169827:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788865016.169830:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865016.170021:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.170027:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4fbabcb/0xf8c13e2d0e95a4cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.170036:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.170039:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.170043:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4fbabcb/0xf8c13e2d0e95a4cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.170052:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4fbabcb/0xf8c13e2d0e95a4cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.170059:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4fbabcb/0xf8c13e2d0e95a4cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.170066:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4fbabcb/0xf8c13e2d0e95a4cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.170090:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788865016.170099:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788865016.170103:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4fbabcb/0xf8c13e2d0e95a4cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.170110:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc05bce00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788865016.170114:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4fbabcb/0xf8c13e2d0e95a4cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.170122:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4fbabcb/0xf8c13e2d0e95a4cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.170134:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4fbabcb/0xf8c13e2d0e95a4cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.170140:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4fbabcb/0xf8c13e2d0e95a4cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.170153:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865016.170166:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865016.170169:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865016.175062:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.175079:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ae877f4/0xf8c13e2d0e95a4d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.175097:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.175113:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.175119:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ae877f4/0xf8c13e2d0e95a4d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.175134:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ae877f4/0xf8c13e2d0e95a4d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.175144:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ae877f4/0xf8c13e2d0e95a4d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.175153:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ae877f4/0xf8c13e2d0e95a4d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.175185:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788865016.175230:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788865016.175237:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ae877f4/0xf8c13e2d0e95a4d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.175246:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc05bd800 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865016.175251:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ae877f4/0xf8c13e2d0e95a4d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.175260:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ae877f4/0xf8c13e2d0e95a4d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.175278:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ae877f4/0xf8c13e2d0e95a4d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.175287:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ae877f4/0xf8c13e2d0e95a4d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.175306:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865016.175308:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865016.175315:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865016.179721:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.179741:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbcc6fef/0xf8c13e2d0e95a4dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.179758:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.179762:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.179768:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbcc6fef/0xf8c13e2d0e95a4dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.179783:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbcc6fef/0xf8c13e2d0e95a4dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.179794:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbcc6fef/0xf8c13e2d0e95a4dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.179818:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbcc6fef/0xf8c13e2d0e95a4dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.179852:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788865016.180047:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788865016.180054:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbcc6fef/0xf8c13e2d0e95a4dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.180063:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc05bd400 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865016.180067:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbcc6fef/0xf8c13e2d0e95a4dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.180083:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbcc6fef/0xf8c13e2d0e95a4dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.180099:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbcc6fef/0xf8c13e2d0e95a4dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.180106:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbcc6fef/0xf8c13e2d0e95a4dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.180200:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865016.180203:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865016.180204:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865016.180462:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.180468:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025782abb/0xf8c13e2d0e95a4e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.180476:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.180480:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.180484:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025782abb/0xf8c13e2d0e95a4e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.180493:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025782abb/0xf8c13e2d0e95a4e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.180501:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025782abb/0xf8c13e2d0e95a4e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.180509:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025782abb/0xf8c13e2d0e95a4e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.180531:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788865016.180777:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788865016.180782:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025782abb/0xf8c13e2d0e95a4e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.180789:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc05bd600 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865016.180793:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025782abb/0xf8c13e2d0e95a4e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.180812:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025782abb/0xf8c13e2d0e95a4e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.180825:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025782abb/0xf8c13e2d0e95a4e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.180831:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025782abb/0xf8c13e2d0e95a4e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.180846:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865016.180847:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865016.180849:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865016.181463:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.181471:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac64db36/0xf8c13e2d0e95a4eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.181487:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.181490:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.181495:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac64db36/0xf8c13e2d0e95a4eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.181506:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac64db36/0xf8c13e2d0e95a4eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.181516:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac64db36/0xf8c13e2d0e95a4eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.181523:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac64db36/0xf8c13e2d0e95a4eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.181546:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788865016.182056:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.182063:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7f820bf/0xf8c13e2d0e95a4f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.182072:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.182075:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.182079:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7f820bf/0xf8c13e2d0e95a4f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.182089:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7f820bf/0xf8c13e2d0e95a4f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.182107:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7f820bf/0xf8c13e2d0e95a4f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.182114:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7f820bf/0xf8c13e2d0e95a4f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.182126:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788865016.182612:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788865016.182620:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac64db36/0xf8c13e2d0e95a4eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.182630:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc05bc000 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865016.182635:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac64db36/0xf8c13e2d0e95a4eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.182644:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac64db36/0xf8c13e2d0e95a4eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.182660:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac64db36/0xf8c13e2d0e95a4eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.182680:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac64db36/0xf8c13e2d0e95a4eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.182699:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788865016.182716:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7f820bf/0xf8c13e2d0e95a4f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.182723:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc05bd200 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865016.182726:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7f820bf/0xf8c13e2d0e95a4f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.182734:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7f820bf/0xf8c13e2d0e95a4f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.182745:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7f820bf/0xf8c13e2d0e95a4f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.182752:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7f820bf/0xf8c13e2d0e95a4f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.182765:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865016.182767:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865016.182769:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865016.182776:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865016.185634:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.185647:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039a93919/0xf8c13e2d0e95a4f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.187138:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.187148:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.187165:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039a93919/0xf8c13e2d0e95a4f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.187185:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039a93919/0xf8c13e2d0e95a4f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.187197:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039a93919/0xf8c13e2d0e95a4f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.187206:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039a93919/0xf8c13e2d0e95a4f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.187246:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788865016.187269:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788865016.187276:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039a93919/0xf8c13e2d0e95a4f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.187291:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc05bc400 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865016.187295:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039a93919/0xf8c13e2d0e95a4f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.187303:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039a93919/0xf8c13e2d0e95a4f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.187319:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039a93919/0xf8c13e2d0e95a4f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.187327:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039a93919/0xf8c13e2d0e95a4f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.187348:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865016.187350:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865016.187351:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865016.187823:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.187830:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a84a662/0xf8c13e2d0e95a500 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.187840:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.187843:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.187847:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a84a662/0xf8c13e2d0e95a500 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.187856:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a84a662/0xf8c13e2d0e95a500 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.187863:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a84a662/0xf8c13e2d0e95a500 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.187871:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a84a662/0xf8c13e2d0e95a500 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.187892:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788865016.188627:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.188635:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008721a785/0xf8c13e2d0e95a507 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.188646:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.188655:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.188659:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008721a785/0xf8c13e2d0e95a507 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.188810:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788865016.188818:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a84a662/0xf8c13e2d0e95a500 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.188825:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcc05bc200 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865016.188830:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a84a662/0xf8c13e2d0e95a500 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.188839:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a84a662/0xf8c13e2d0e95a500 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.188862:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a84a662/0xf8c13e2d0e95a500 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.188869:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a84a662/0xf8c13e2d0e95a500 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.188891:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865016.188893:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865016.188895:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865016.192002:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008721a785/0xf8c13e2d0e95a507 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.192019:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008721a785/0xf8c13e2d0e95a507 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.192029:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008721a785/0xf8c13e2d0e95a507 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.192113:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788865016.192694:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.192727:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b8c71bd/0xf8c13e2d0e95a50e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.192740:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.192744:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.192750:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b8c71bd/0xf8c13e2d0e95a50e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.192758:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b8c71bd/0xf8c13e2d0e95a50e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.192766:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b8c71bd/0xf8c13e2d0e95a50e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.192779:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b8c71bd/0xf8c13e2d0e95a50e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.192791:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788865016.193978:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788865016.193988:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008721a785/0xf8c13e2d0e95a507 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.194000:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcbd0c7400 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865016.194005:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008721a785/0xf8c13e2d0e95a507 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.194014:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008721a785/0xf8c13e2d0e95a507 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.194033:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008721a785/0xf8c13e2d0e95a507 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.194041:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008721a785/0xf8c13e2d0e95a507 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.194089:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788865016.194093:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b8c71bd/0xf8c13e2d0e95a50e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.194100:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcbd0c6e00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865016.194103:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b8c71bd/0xf8c13e2d0e95a50e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.194111:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b8c71bd/0xf8c13e2d0e95a50e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.194121:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b8c71bd/0xf8c13e2d0e95a50e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.194130:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b8c71bd/0xf8c13e2d0e95a50e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.194141:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865016.194143:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865016.194145:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865016.194178:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865016.194480:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.194487:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb0f9534/0xf8c13e2d0e95a515 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.194499:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.194502:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.194508:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb0f9534/0xf8c13e2d0e95a515 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.194519:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb0f9534/0xf8c13e2d0e95a515 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.194527:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb0f9534/0xf8c13e2d0e95a515 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.194535:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb0f9534/0xf8c13e2d0e95a515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.194550:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788865016.194559:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788865016.194562:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb0f9534/0xf8c13e2d0e95a515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.194577:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcbd0c6600 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788865016.194580:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb0f9534/0xf8c13e2d0e95a515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.194589:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb0f9534/0xf8c13e2d0e95a515 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.194600:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb0f9534/0xf8c13e2d0e95a515 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.194608:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb0f9534/0xf8c13e2d0e95a515 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.194621:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865016.194623:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865016.194625:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865016.196193:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.196204:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c34a24b0/0xf8c13e2d0e95a51c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.196218:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.196222:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.196227:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c34a24b0/0xf8c13e2d0e95a51c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.196239:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c34a24b0/0xf8c13e2d0e95a51c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.196255:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c34a24b0/0xf8c13e2d0e95a51c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.196262:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c34a24b0/0xf8c13e2d0e95a51c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.196314:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788865016.196769:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.196775:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c4f0218/0xf8c13e2d0e95a523 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.196784:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.196787:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.196791:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c4f0218/0xf8c13e2d0e95a523 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.196800:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c4f0218/0xf8c13e2d0e95a523 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.196808:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c4f0218/0xf8c13e2d0e95a523 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.196815:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c4f0218/0xf8c13e2d0e95a523 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.199263:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788865016.199276:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c34a24b0/0xf8c13e2d0e95a51c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.199290:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcbd0c6a00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865016.199304:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c34a24b0/0xf8c13e2d0e95a51c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.199315:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c34a24b0/0xf8c13e2d0e95a51c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.199334:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c34a24b0/0xf8c13e2d0e95a51c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.199343:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c34a24b0/0xf8c13e2d0e95a51c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.199362:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788865016.199366:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c4f0218/0xf8c13e2d0e95a523 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.199372:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcbd0c6800 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865016.199375:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c4f0218/0xf8c13e2d0e95a523 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.199383:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c4f0218/0xf8c13e2d0e95a523 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.199393:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c4f0218/0xf8c13e2d0e95a523 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.199400:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865016.199408:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865016.199410:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865016.199584:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788865016.199592:0:14985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c4f0218/0xf8c13e2d0e95a523 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788865016.200193:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.200200:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006decf224/0xf8c13e2d0e95a52a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.200212:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.200216:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.200222:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006decf224/0xf8c13e2d0e95a52a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.200232:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006decf224/0xf8c13e2d0e95a52a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.200240:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006decf224/0xf8c13e2d0e95a52a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.200247:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006decf224/0xf8c13e2d0e95a52a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.200264:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788865016.200607:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.200613:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ac1d3f7/0xf8c13e2d0e95a531 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.200628:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.200631:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.200636:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ac1d3f7/0xf8c13e2d0e95a531 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.200645:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ac1d3f7/0xf8c13e2d0e95a531 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.200653:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ac1d3f7/0xf8c13e2d0e95a531 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.200660:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ac1d3f7/0xf8c13e2d0e95a531 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.200670:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788865016.200801:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788865016.200810:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006decf224/0xf8c13e2d0e95a52a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.200820:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcbd0c7c00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:2.0:1788865016.200825:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006decf224/0xf8c13e2d0e95a52a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.200836:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006decf224/0xf8c13e2d0e95a52a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.200855:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006decf224/0xf8c13e2d0e95a52a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.200864:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006decf224/0xf8c13e2d0e95a52a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.200889:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788865016.200893:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ac1d3f7/0xf8c13e2d0e95a531 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.200901:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcbd0c6c00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:2.0:1788865016.200905:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ac1d3f7/0xf8c13e2d0e95a531 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.200921:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ac1d3f7/0xf8c13e2d0e95a531 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.200932:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ac1d3f7/0xf8c13e2d0e95a531 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.200940:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ac1d3f7/0xf8c13e2d0e95a531 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.200955:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788865016.200957:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788865016.200959:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865016.201077:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.201082:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008aa254d3/0xf8c13e2d0e95a538 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.201090:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.201093:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.201097:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008aa254d3/0xf8c13e2d0e95a538 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.201105:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008aa254d3/0xf8c13e2d0e95a538 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.201122:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008aa254d3/0xf8c13e2d0e95a538 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.201129:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008aa254d3/0xf8c13e2d0e95a538 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.201148:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788865016.201310:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788865016.201316:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008aa254d3/0xf8c13e2d0e95a538 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.201324:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcbd0c7800 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:2.0:1788865016.201328:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008aa254d3/0xf8c13e2d0e95a538 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.201336:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008aa254d3/0xf8c13e2d0e95a538 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.201349:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008aa254d3/0xf8c13e2d0e95a538 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.201370:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008aa254d3/0xf8c13e2d0e95a538 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.201386:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788865016.201388:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788865016.201390:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865016.201521:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.201527:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c25412ae/0xf8c13e2d0e95a53f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.201535:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.201538:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.201542:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c25412ae/0xf8c13e2d0e95a53f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.201551:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c25412ae/0xf8c13e2d0e95a53f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.201560:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c25412ae/0xf8c13e2d0e95a53f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.201567:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c25412ae/0xf8c13e2d0e95a53f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.201598:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788865016.201815:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788865016.201821:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c25412ae/0xf8c13e2d0e95a53f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.201829:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcbd0c6200 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:2.0:1788865016.201833:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c25412ae/0xf8c13e2d0e95a53f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.201841:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c25412ae/0xf8c13e2d0e95a53f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.201854:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c25412ae/0xf8c13e2d0e95a53f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.201861:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c25412ae/0xf8c13e2d0e95a53f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.201879:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788865016.201881:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788865016.201883:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865016.201986:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.201991:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000950dd58a/0xf8c13e2d0e95a546 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.201999:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.202002:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.202006:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000950dd58a/0xf8c13e2d0e95a546 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.202014:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000950dd58a/0xf8c13e2d0e95a546 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.202021:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000950dd58a/0xf8c13e2d0e95a546 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.202028:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000950dd58a/0xf8c13e2d0e95a546 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.202052:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788865016.202083:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788865016.202089:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000950dd58a/0xf8c13e2d0e95a546 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.202097:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcbd0c6400 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:2.0:1788865016.202101:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000950dd58a/0xf8c13e2d0e95a546 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.202109:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000950dd58a/0xf8c13e2d0e95a546 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.202236:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000950dd58a/0xf8c13e2d0e95a546 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.202246:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000950dd58a/0xf8c13e2d0e95a546 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.202264:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788865016.202266:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788865016.202269:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865016.202439:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.202444:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ec6fd5c/0xf8c13e2d0e95a54d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.202452:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.202459:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.202463:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ec6fd5c/0xf8c13e2d0e95a54d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.202472:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ec6fd5c/0xf8c13e2d0e95a54d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.202480:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ec6fd5c/0xf8c13e2d0e95a54d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.202486:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ec6fd5c/0xf8c13e2d0e95a54d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.202500:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788865016.202870:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.202876:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9129b6f/0xf8c13e2d0e95a554 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.202884:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.202886:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.202890:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9129b6f/0xf8c13e2d0e95a554 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.202898:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9129b6f/0xf8c13e2d0e95a554 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.202906:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9129b6f/0xf8c13e2d0e95a554 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.202918:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9129b6f/0xf8c13e2d0e95a554 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.202925:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788865016.203216:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788865016.203223:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ec6fd5c/0xf8c13e2d0e95a54d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.203230:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcbd0c7000 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865016.203234:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ec6fd5c/0xf8c13e2d0e95a54d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.203242:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ec6fd5c/0xf8c13e2d0e95a54d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.203256:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ec6fd5c/0xf8c13e2d0e95a54d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865016.203263:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ec6fd5c/0xf8c13e2d0e95a54d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.203268:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788865016.203283:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865016.203286:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865016.203289:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865016.203512:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865016.203514:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788865016.203516:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788865016.203746:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9129b6f/0xf8c13e2d0e95a554 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.203756:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcbd0c7a00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:2.0:1788865016.203759:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9129b6f/0xf8c13e2d0e95a554 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.203779:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9129b6f/0xf8c13e2d0e95a554 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.203792:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9129b6f/0xf8c13e2d0e95a554 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.203800:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9129b6f/0xf8c13e2d0e95a554 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865016.203817:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788865016.203819:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788865016.203821:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788865016.207448:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788865016.207520:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d6f0d10/0xf8c13e2d0e95a55b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.207538:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1788865016.207543:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788865016.207549:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d6f0d10/0xf8c13e2d0e95a55b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.207564:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d6f0d10/0xf8c13e2d0e95a55b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.207575:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d6f0d10/0xf8c13e2d0e95a55b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.207582:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d6f0d10/0xf8c13e2d0e95a55b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.207609:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788865016.207627:0:16051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788865016.207633:0:16051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d6f0d10/0xf8c13e2d0e95a55b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.207649:0:16051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcbd0c7200 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788865016.207653:0:16051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d6f0d10/0xf8c13e2d0e95a55b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.207662:0:16051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d6f0d10/0xf8c13e2d0e95a55b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.207677:0:16051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d6f0d10/0xf8c13e2d0e95a55b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.207684:0:16051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d6f0d10/0xf8c13e2d0e95a55b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865016.207721:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865016.207722:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865016.207724:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788865016.208025:0:14985:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1788865016.208106:0:14985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14326:x1875760546677120:12345-0@lo:5:osp-pre-1-0.0 Request processed in 63953us (64119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865016.208114:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788865016.208180:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81927800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14326:1875760546677120:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788865016.208197:0:14326:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1788865016.208238:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14326:1875760546677248:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788865016.208270:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788865016.208317:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca8d28b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788865016.208335:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546677248 00000100:00100000:0.0:1788865016.208342:0:14986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546677248 00000100:00100000:0.0:1788865016.208381:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788865016.208390:0:14986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14326:x1875760546677248:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788865016.208423:0:14986:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:3.0:1788865016.208746:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788865016.214626:0:14986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14326:x1875760546677248:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6229us (6347us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788865016.214641:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788865016.214823:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14326:1875760546677248:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788865016.214839:0:14326:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:3.0:1788865016.237095:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:02000400:0.0:1788865016.305663:0:16061:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:2.0:1788865016.520777:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788865017.221022:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788865018.229579:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788865018.229759:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528857344 00000100:00100000:3.0:1788865018.229781:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528857344 00000100:00100000:3.0:1788865018.229824:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:3.0:1788865018.229833:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2355:x1875760528857344:12345-192.168.203.13@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788865018.229860:0:14295:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 6e4b30ef-707f-4a68-abf9-d500481ae7c8@192.168.203.13@tcp t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:3.0:1788865018.229899:0:14295:0:(genops.c:1384:class_connect()) connect: client 6e4b30ef-707f-4a68-abf9-d500481ae7c8, cookie 0xf8c13e2d0e95a562 00000100:00080000:3.0:1788865018.230040:0:14295:0:(import.c:65:import_set_state_nolock()) ffff9fdb82ca3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788865018.230122:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e4b30ef-707f-4a68-abf9-d500481ae7c8+5:2355:x1875760528857344:12345-192.168.203.13@tcp:250:mount.lustre.0 Request processed in 288us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865018.230130:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:1.0:1788865018.241465:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865018.241533:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528857472 00000100:00100000:2.0:1788865018.241547:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528857472 00000100:00100000:2.0:1788865018.241625:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:2.0:1788865018.241635:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+5:13755:x1875760528857472:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788865018.241652:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788865018.241669:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcb5385800/0xf8c13e2d0e95a569 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fea6 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865018.241697:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcb5385800/0xf8c13e2d0e95a569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fea6 expref: 6 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865018.241733:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcb5385800/0xf8c13e2d0e95a569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fea6 expref: 6 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865018.241754:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385800, rc 0) 00000100:00100000:2.0:1788865018.241973:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+6:13755:x1875760528857472:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 338us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865018.241981:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:1.0:1788865018.244102:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865018.244810:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528857600 00000100:00100000:2.0:1788865018.244824:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528857600 00000100:00100000:2.0:1788865018.245115:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:2.0:1788865018.245130:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e4b30ef-707f-4a68-abf9-d500481ae7c8+6:13755:x1875760528857600:12345-192.168.203.13@tcp:501:mount.lustre.0 00010000:00010000:1.0:1788865018.245781:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788865018.247262:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e4b30ef-707f-4a68-abf9-d500481ae7c8+6:13755:x1875760528857600:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 2119us (3255us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788865018.247283:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:1.0:1788865018.253251:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865018.253326:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528857728 00000100:00100000:0.0:1788865018.253343:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528857728 00000100:00100000:0.0:1788865018.253418:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:0.0:1788865018.253430:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e4b30ef-707f-4a68-abf9-d500481ae7c8+6:13755:x1875760528857728:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788865018.253448:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788865018.253469:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcbd0c6800/0xf8c13e2d0e95a570 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fead expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865018.253498:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcbd0c6800/0xf8c13e2d0e95a570 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fead expref: 7 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865018.253509:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcbd0c6800/0xf8c13e2d0e95a570 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fead expref: 7 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865018.253518:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcbd0c6800, rc 0) 00000100:00100000:0.0:1788865018.253601:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e4b30ef-707f-4a68-abf9-d500481ae7c8+7:13755:x1875760528857728:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 173us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865018.253608:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:1.0:1788865018.259538:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865018.259668:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528857856 00000100:00100000:2.0:1788865018.259681:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528857856 00000100:00100000:2.0:1788865018.259786:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:2.0:1788865018.259798:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e4b30ef-707f-4a68-abf9-d500481ae7c8+7:13755:x1875760528857856:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788865018.260216:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e4b30ef-707f-4a68-abf9-d500481ae7c8+8:13755:x1875760528857856:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 419us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865018.260227:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:1.0:1788865018.262456:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865018.262533:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528857984 00000100:00100000:0.0:1788865018.262549:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528857984 00000100:00100000:0.0:1788865018.262627:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:0.0:1788865018.262637:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e4b30ef-707f-4a68-abf9-d500481ae7c8+8:13755:x1875760528857984:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788865018.263214:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e4b30ef-707f-4a68-abf9-d500481ae7c8+8:13755:x1875760528857984:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 575us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865018.263223:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:1.0:1788865018.266825:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865018.267985:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528858112 00000100:00100000:0.0:1788865018.267999:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528858112 00000100:00100000:0.0:1788865018.268079:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:0.0:1788865018.268093:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+8:13773:x1875760528858112:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788865018.268576:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+8:13773:x1875760528858112:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 485us (1765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865018.268587:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:1.0:1788865018.292929:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865018.293136:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528858240 00000100:00100000:2.0:1788865018.293159:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528858240 00000100:00100000:2.0:1788865018.293231:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:2.0:1788865018.293244:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e4b30ef-707f-4a68-abf9-d500481ae7c8+8:13773:x1875760528858240:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788865018.293593:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e4b30ef-707f-4a68-abf9-d500481ae7c8+8:13773:x1875760528858240:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 351us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865018.293613:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:1.0:1788865018.301954:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865018.302066:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528858368 00000100:00100000:0.0:1788865018.302080:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528858368 00000100:00100000:0.0:1788865018.302161:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:0.0:1788865018.302175:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac5f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+8:13755:x1875760528858368:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788865018.302197:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788865018.302219:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcbd0c6600/0xf8c13e2d0e95a577 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fed7 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865018.302255:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcbd0c6600/0xf8c13e2d0e95a577 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fed7 expref: 9 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865018.302269:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcbd0c6600/0xf8c13e2d0e95a577 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fed7 expref: 9 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865018.302302:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcbd0c6600, rc 0) 00000100:00100000:0.0:1788865018.302376:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac5f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+9:13755:x1875760528858368:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 203us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865018.302384:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:1.0:1788865018.309296:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788865018.310139:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528858496 00000100:00100000:3.0:1788865018.310168:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528858496 00000100:00100000:3.0:1788865018.310252:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:3.0:1788865018.310264:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e4b30ef-707f-4a68-abf9-d500481ae7c8+9:13755:x1875760528858496:12345-192.168.203.13@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788865018.310298:0:14295:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788865018.310331:0:14295:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788865018.310336:0:14295:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788865018.310339:0:14295:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788865018.310342:0:14295:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1788865018.325780:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e4b30ef-707f-4a68-abf9-d500481ae7c8+9:13755:x1875760528858496:12345-192.168.203.13@tcp:256:mount.lustre.0 Request processed in 15501us (16482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865018.325816:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:0.0:1788865018.337650:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865018.337759:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528858624 00000100:00100000:2.0:1788865018.337773:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528858624 00000100:00100000:2.0:1788865018.337857:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:2.0:1788865018.337870:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e4b30ef-707f-4a68-abf9-d500481ae7c8+9:13755:x1875760528858624:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788865018.337892:0:14293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788865018.337915:0:14293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcb5384a00/0xf8c13e2d0e95a57e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fede expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865018.337965:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcb5384a00/0xf8c13e2d0e95a57e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fede expref: 10 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865018.337978:0:14293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcb5384a00/0xf8c13e2d0e95a57e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fede expref: 10 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865018.337989:0:14293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384a00, rc 0) 00000100:00100000:2.0:1788865018.338063:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e4b30ef-707f-4a68-abf9-d500481ae7c8+10:13755:x1875760528858624:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 196us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865018.338068:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:1.0:1788865018.342357:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788865018.344761:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528858752 00000100:00100000:3.0:1788865018.344783:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528858752 00000100:00100000:3.0:1788865018.344879:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:3.0:1788865018.344892:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e4b30ef-707f-4a68-abf9-d500481ae7c8+10:13755:x1875760528858752:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788865018.345773:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e4b30ef-707f-4a68-abf9-d500481ae7c8+10:13755:x1875760528858752:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 877us (3424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865018.345784:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:1.0:1788865018.350480:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865018.352051:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528858880 00000100:00100000:0.0:1788865018.352071:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528858880 00000100:00100000:0.0:1788865018.352252:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:0.0:1788865018.352267:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+10:13755:x1875760528858880:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788865018.353233:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+10:13755:x1875760528858880:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 958us (2756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865018.353249:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:0.0:1788865018.366434:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788865018.366599:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528859008 00000100:00100000:3.0:1788865018.366612:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528859008 00000100:00100000:3.0:1788865018.366694:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:3.0:1788865018.366738:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e4b30ef-707f-4a68-abf9-d500481ae7c8+10:13779:x1875760528859008:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788865018.367451:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e4b30ef-707f-4a68-abf9-d500481ae7c8+10:13779:x1875760528859008:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 742us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865018.367462:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:2.0:1788865018.373129:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865018.373244:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528859136 00000100:00100000:0.0:1788865018.373258:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528859136 00000100:00100000:0.0:1788865018.373337:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00100000:0.0:1788865018.373349:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+10:13779:x1875760528859136:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788865018.373697:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+10:13779:x1875760528859136:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 349us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865018.373727:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00100000:1.0:1788865018.396244:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788865018.396975:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528859264 00000100:00100000:3.0:1788865018.396990:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528859264 00000100:00100000:3.0:1788865018.397077:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:3.0:1788865018.397088:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2355:x1875760528859264:12345-192.168.203.13@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788865018.397127:0:14303:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 14989055-e60f-465d-a477-346c1f551105@192.168.203.13@tcp t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:3.0:1788865018.397206:0:14303:0:(genops.c:1384:class_connect()) connect: client 14989055-e60f-465d-a477-346c1f551105, cookie 0xf8c13e2d0e95a585 00000004:00100000:3.0:1788865018.397246:0:14303:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788865018.397267:0:14303:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788865018.478003:0:14303:0:(import.c:65:import_set_state_nolock()) ffff9fdcc0033000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788865018.478118:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14989055-e60f-465d-a477-346c1f551105+6:2355:x1875760528859264:12345-192.168.203.13@tcp:38:mount.lustre.0 Request processed in 81029us (81888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865018.478132:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:3.0:1788865018.483406:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865018.483929:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528859392 00000100:00100000:2.0:1788865018.483939:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528859392 00000100:00100000:1.0:1788865018.483959:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865018.484023:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528859520 00000100:00100000:2.0:1788865018.484026:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528859520 00000100:00100000:2.0:1788865018.484064:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:2.0:1788865018.484075:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14989055-e60f-465d-a477-346c1f551105+7:0:x1875760528859392:12345-192.168.203.13@tcp:41:mount.lustre.0 00000100:00100000:1.0:1788865018.484105:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1788865018.484119:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14989055-e60f-465d-a477-346c1f551105+7:13755:x1875760528859520:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788865018.484125:0:14300:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000004:00000024:1.0:1788865018.484148:0:14301:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1788865018.484272:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788865018.484340:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14989055-e60f-465d-a477-346c1f551105+7:0:x1875760528859392:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 266us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865018.484348:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:1.0:1788865018.487597:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14989055-e60f-465d-a477-346c1f551105+6:13755:x1875760528859520:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 3471us (3628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865018.487612:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:3.0:1788865018.501880:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865018.503174:0:15714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528859648 00000100:00100000:0.0:1788865018.503187:0:15714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528859648 00000100:00100000:0.0:1788865018.503308:0:15714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:0.0:1788865018.503320:0:15714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14989055-e60f-465d-a477-346c1f551105+6:13755:x1875760528859648:12345-192.168.203.13@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788865018.503410:0:15714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14989055-e60f-465d-a477-346c1f551105+6:13755:x1875760528859648:12345-192.168.203.13@tcp:40:mount.lustre.0 Request processed in 94us (1538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865018.503417:0:15714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1788865018.523170:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865018.523211:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865018.523238:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865018.523345:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865018.523375:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528860160 00000100:00100000:2.0:1788865018.523383:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528860160 00000100:00100000:2.0:1788865018.523443:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:2.0:1788865018.523452:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e4b30ef-707f-4a68-abf9-d500481ae7c8+10:2358:x1875760528860160:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788865018.523516:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e4b30ef-707f-4a68-abf9-d500481ae7c8+10:2358:x1875760528860160:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 65us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865018.523524:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:0.0:1788865018.524189:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528860032 00000100:00100000:0.0:1788865018.524196:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528860032 00000100:00100000:0.0:1788865018.524240:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:0.0:1788865018.524249:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14989055-e60f-465d-a477-346c1f551105+6:13755:x1875760528860032:12345-192.168.203.13@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788865018.527085:0:14304:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2764us 00000100:00100000:3.0:1788865018.528031:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528859776 00000100:00100000:3.0:1788865018.528043:0:14983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528859776 00000100:00100000:2.0:1788865018.528156:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528859904 00000100:00100000:2.0:1788865018.528161:0:14983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528859904 00000100:00100000:2.0:1788865018.528188:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:2.0:1788865018.528196:0:14986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1875760528859776:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788865018.528223:0:14986:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 14989055-e60f-465d-a477-346c1f551105@192.168.203.13@tcp t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:2.0:1788865018.528253:0:14986:0:(genops.c:1384:class_connect()) connect: client 14989055-e60f-465d-a477-346c1f551105, cookie 0xf8c13e2d0e95a58c 00002000:00100000:2.0:1788865018.528265:0:14986:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 14989055-e60f-465d-a477-346c1f551105/ffff9fdc8861f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788865018.528288:0:14986:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788865018.528594:0:14986:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788865018.528629:0:14986:0:(import.c:65:import_set_state_nolock()) ffff9fdc8861b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788865018.528699:0:14986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14989055-e60f-465d-a477-346c1f551105+6:2355:x1875760528859776:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 502us (5487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865018.528739:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:2.0:1788865018.528757:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:2.0:1788865018.528762:0:14986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1875760528859904:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788865018.528854:0:14986:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 14989055-e60f-465d-a477-346c1f551105@192.168.203.13@tcp t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:2.0:1788865018.528872:0:14986:0:(genops.c:1384:class_connect()) connect: client 14989055-e60f-465d-a477-346c1f551105, cookie 0xf8c13e2d0e95a593 00002000:00100000:2.0:1788865018.528878:0:14986:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 14989055-e60f-465d-a477-346c1f551105/ffff9fdc8861b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788865018.528891:0:14986:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788865018.530009:0:14986:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788865018.530040:0:14986:0:(import.c:65:import_set_state_nolock()) ffff9fdc8861a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788865018.530092:0:14986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14989055-e60f-465d-a477-346c1f551105+6:2355:x1875760528859904:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 1328us (6852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865018.530101:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000004:00200000:1.0:1788865018.547210:0:14304:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788865018.547667:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14989055-e60f-465d-a477-346c1f551105+6:13755:x1875760528860032:12345-192.168.203.13@tcp:33:mount.lustre.0 Request processed in 23415us (24501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865018.547683:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:2.0:1788865018.775930:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865018.776031:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528860288 00000100:00100000:0.0:1788865018.776050:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528860288 00000100:00100000:0.0:1788865018.776109:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:0.0:1788865018.776122:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14989055-e60f-465d-a477-346c1f551105+6:13800:x1875760528860288:12345-192.168.203.13@tcp:101:mkdir.0 00010000:00010000:0.0:1788865018.776157:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788865018.776185:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7600/0xf8c13e2d0e95a59a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975ff08 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865018.776257:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7e00/0xf8c13e2d0e95a5a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865018.776271:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7e00/0xf8c13e2d0e95a5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865018.776286:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7e00/0xf8c13e2d0e95a5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788865018.776335:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788865018.776338:0:14303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788865018.776380:0:14303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7e00/0xf8c13e2d0e95a5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865018.776405:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7600/0xf8c13e2d0e95a59a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff08 expref: 8 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865018.776419:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7e00/0xf8c13e2d0e95a5a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff08 expref: 7 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865018.776427:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc8399ae00) 00010000:00010000:0.0:1788865018.776430:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788865018.776433:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcbd0c7e00, rc 0) 00000100:00100000:0.0:1788865018.776520:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14989055-e60f-465d-a477-346c1f551105+7:13800:x1875760528860288:12345-192.168.203.13@tcp:101:mkdir.0 Request processed in 400us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865018.776527:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00010000:00010000:3.0:1788865019.274266:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788865020.229431:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546677376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788865020.229507:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788865020.230151:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546677376 00000100:00100000:1.0:1788865020.230160:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546677376 00000100:00100000:1.0:1788865020.230238:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788865020.230264:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546677376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788865020.230301:0:14987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788865020.230366:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546677376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865020.230373:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788865020.230544:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788865020.230573:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546677376:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788865020.292960:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788865020.721332:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865020.721427:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528860416 00000100:00100000:2.0:1788865020.721438:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528860416 00000100:00100000:2.0:1788865020.721533:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:2.0:1788865020.721544:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14989055-e60f-465d-a477-346c1f551105+7:13853:x1875760528860416:12345-192.168.203.13@tcp:41:lfs.0 00000004:00000024:2.0:1788865020.721586:0:14300:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788865020.721689:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14989055-e60f-465d-a477-346c1f551105+7:13853:x1875760528860416:12345-192.168.203.13@tcp:41:lfs.0 Request processed in 146us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865020.721696:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00080000:3.0:1788865020.721986:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788865020.724818:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788865020.726297:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528860544 00000100:00100000:3.0:1788865020.726311:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528860544 00000100:00100000:3.0:1788865020.726441:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:3.0:1788865020.726451:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:14989055-e60f-465d-a477-346c1f551105+6:13853:x1875760528860544:12345-192.168.203.13@tcp:13:lfs.0 00002000:00000024:3.0:1788865020.726487:0:14987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788865020.726590:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:14989055-e60f-465d-a477-346c1f551105+6:13853:x1875760528860544:12345-192.168.203.13@tcp:13:lfs.0 Request processed in 139us (1779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865020.726597:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00080000:2.0:1788865020.728299:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788865020.730360:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788865020.732509:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528860672 00000100:00100000:3.0:1788865020.732532:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528860672 00000100:00100000:3.0:1788865020.732620:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:3.0:1788865020.732632:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:14989055-e60f-465d-a477-346c1f551105+6:13853:x1875760528860672:12345-192.168.203.13@tcp:13:lfs.0 00002000:00000024:3.0:1788865020.732677:0:14987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788865020.732810:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:14989055-e60f-465d-a477-346c1f551105+6:13853:x1875760528860672:12345-192.168.203.13@tcp:13:lfs.0 Request processed in 180us (2457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865020.732818:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00080000:2.0:1788865020.732945:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788865020.939700:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865020.939799:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528860800 00000100:00100000:2.0:1788865020.939810:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528860800 00000100:00100000:2.0:1788865020.939868:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:2.0:1788865020.939878:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+10:13885:x1875760528860800:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788865020.939894:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788865020.939911:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcb5385600/0xf8c13e2d0e95a5a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c2384dba975ff0f expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865020.939940:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcb5385600/0xf8c13e2d0e95a5a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff0f expref: 11 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865020.939952:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcb5385600/0xf8c13e2d0e95a5a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff0f expref: 11 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865020.939961:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385600, rc 0) 00000100:00100000:2.0:1788865020.940055:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+11:13885:x1875760528860800:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 179us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865020.940062:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:0.0:1788865020.957251:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865020.957351:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528860928 00000100:00100000:2.0:1788865020.957362:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528860928 00000100:00100000:2.0:1788865020.957452:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 92 00000100:00100000:2.0:1788865020.957463:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e4b30ef-707f-4a68-abf9-d500481ae7c8+11:13885:x1875760528860928:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788865020.957796:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e4b30ef-707f-4a68-abf9-d500481ae7c8+11:13885:x1875760528860928:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 334us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865020.957806:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 92 00000100:00100000:1.0:1788865020.962222:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865020.962304:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528861056 00000100:00100000:2.0:1788865020.962315:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528861056 00000100:00100000:2.0:1788865020.962370:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:2.0:1788865020.962394:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+11:13885:x1875760528861056:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788865020.962978:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+11:13885:x1875760528861056:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 585us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865020.962988:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:3.0:1788865020.977734:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865020.978058:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528861184 00000100:00100000:2.0:1788865020.978068:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528861184 00000100:00100000:2.0:1788865020.978119:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:2.0:1788865020.978144:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e4b30ef-707f-4a68-abf9-d500481ae7c8+11:13892:x1875760528861184:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788865020.978407:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e4b30ef-707f-4a68-abf9-d500481ae7c8+11:13892:x1875760528861184:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 264us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865020.978415:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:0.0:1788865020.994944:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865020.995655:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528861312 00000100:00100000:2.0:1788865020.995665:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528861312 00000100:00100000:2.0:1788865020.995760:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 95 00000100:00100000:2.0:1788865020.995771:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+11:13892:x1875760528861312:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788865020.996052:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+11:13892:x1875760528861312:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 282us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865020.996059:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 95 00000100:00100000:1.0:1788865021.005829:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865021.006080:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528861440 00000100:00100000:0.0:1788865021.006091:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528861440 00000100:00100000:0.0:1788865021.006159:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 96 00000100:00100000:0.0:1788865021.006170:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e4b30ef-707f-4a68-abf9-d500481ae7c8+11:13885:x1875760528861440:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788865021.006186:0:14293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788865021.006215:0:14293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcbd0c6400/0xf8c13e2d0e95a5af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c2384dba975ff39 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865021.006243:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcbd0c6400/0xf8c13e2d0e95a5af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff39 expref: 12 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865021.006254:0:14293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcbd0c6400/0xf8c13e2d0e95a5af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff39 expref: 12 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865021.006264:0:14293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcbd0c6400, rc 0) 00000100:00100000:0.0:1788865021.006329:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e4b30ef-707f-4a68-abf9-d500481ae7c8+12:13885:x1875760528861440:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 161us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865021.006336:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 96 00000100:00100000:0.0:1788865021.010013:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788865021.010906:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528861568 00000100:00100000:3.0:1788865021.010919:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528861568 00000100:00100000:3.0:1788865021.010978:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:3.0:1788865021.010987:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e4b30ef-707f-4a68-abf9-d500481ae7c8+12:13885:x1875760528861568:12345-192.168.203.13@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788865021.011014:0:14295:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788865021.011038:0:14295:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788865021.011042:0:14295:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788865021.011046:0:14295:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788865021.011048:0:14295:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1788865021.021746:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e4b30ef-707f-4a68-abf9-d500481ae7c8+12:13885:x1875760528861568:12345-192.168.203.13@tcp:256:mount.lustre.0 Request processed in 10749us (11731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865021.021762:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:0.0:1788865021.030854:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865021.031001:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528861696 00000100:00100000:2.0:1788865021.031011:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528861696 00000100:00100000:2.0:1788865021.031064:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:2.0:1788865021.031074:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+12:13885:x1875760528861696:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788865021.031090:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788865021.031107:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcb5384600/0xf8c13e2d0e95a5b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c2384dba975ff40 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865021.031163:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcb5384600/0xf8c13e2d0e95a5b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff40 expref: 13 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865021.031174:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcb5384600/0xf8c13e2d0e95a5b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff40 expref: 13 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865021.031183:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384600, rc 0) 00000100:00100000:2.0:1788865021.031238:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+13:13885:x1875760528861696:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 165us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865021.031245:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:0.0:1788865021.033477:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788865021.033570:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528861824 00000100:00100000:3.0:1788865021.033579:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528861824 00000100:00100000:3.0:1788865021.033689:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:3.0:1788865021.033733:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc00e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e4b30ef-707f-4a68-abf9-d500481ae7c8+13:13885:x1875760528861824:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788865021.035001:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc00e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e4b30ef-707f-4a68-abf9-d500481ae7c8+13:13885:x1875760528861824:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 1298us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865021.035012:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:1.0:1788865021.042448:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865021.042667:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528861952 00000100:00100000:0.0:1788865021.042676:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528861952 00000100:00100000:0.0:1788865021.042769:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:0.0:1788865021.042779:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e4b30ef-707f-4a68-abf9-d500481ae7c8+13:13885:x1875760528861952:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788865021.043299:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e4b30ef-707f-4a68-abf9-d500481ae7c8+13:13885:x1875760528861952:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 519us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865021.043308:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:0.0:1788865021.046329:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865021.046652:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528862080 00000100:00100000:2.0:1788865021.046662:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528862080 00000100:00100000:2.0:1788865021.046739:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:2.0:1788865021.046749:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+13:13896:x1875760528862080:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788865021.047339:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+13:13896:x1875760528862080:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 589us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865021.047348:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:3.0:1788865021.053229:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865021.053409:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528862208 00000100:00100000:2.0:1788865021.053420:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528862208 00000100:00100000:2.0:1788865021.053522:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 102 00000100:00100000:2.0:1788865021.053533:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e4b30ef-707f-4a68-abf9-d500481ae7c8+13:13896:x1875760528862208:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788865021.053828:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e4b30ef-707f-4a68-abf9-d500481ae7c8+13:13896:x1875760528862208:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 296us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865021.053836:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 102 00000100:00100000:1.0:1788865021.064602:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865021.064736:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528862336 00000100:00100000:0.0:1788865021.064746:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528862336 00000100:00100000:1.0:1788865021.064877:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:1.0:1788865021.064886:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2355:x1875760528862336:12345-192.168.203.13@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788865021.064915:0:14301:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from ae8753b1-5eef-4af3-91d0-fbf927415401@192.168.203.13@tcp t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:1.0:1788865021.064955:0:14301:0:(genops.c:1384:class_connect()) connect: client ae8753b1-5eef-4af3-91d0-fbf927415401, cookie 0xf8c13e2d0e95a5bd 00000004:00100000:1.0:1788865021.064983:0:14301:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788865021.065112:0:14301:0:(import.c:65:import_set_state_nolock()) ffff9fdb82dba000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788865021.065192:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae8753b1-5eef-4af3-91d0-fbf927415401+6:2355:x1875760528862336:12345-192.168.203.13@tcp:38:mount.lustre.0 Request processed in 306us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865021.065200:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:1.0:1788865021.073422:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865021.073463:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865021.073550:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528862464 00000100:00100000:2.0:1788865021.073573:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528862464 00000100:00100000:2.0:1788865021.073736:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528862592 00000100:00100000:2.0:1788865021.073740:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528862592 00000100:00100000:2.0:1788865021.073763:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:2.0:1788865021.073772:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae8753b1-5eef-4af3-91d0-fbf927415401+7:0:x1875760528862464:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788865021.073823:0:14300:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788865021.073888:0:15714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:2.0:1788865021.073891:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae8753b1-5eef-4af3-91d0-fbf927415401+7:0:x1875760528862464:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 118us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865021.073904:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1788865021.073904:0:15714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae8753b1-5eef-4af3-91d0-fbf927415401+7:13885:x1875760528862592:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788865021.073928:0:15714:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788865021.073960:0:15714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae8753b1-5eef-4af3-91d0-fbf927415401+6:13885:x1875760528862592:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 63us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865021.073966:0:15714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00080000:3.0:1788865021.076949:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788865021.086324:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865021.086732:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528862720 00000100:00100000:2.0:1788865021.086743:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528862720 00000100:00100000:2.0:1788865021.086864:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:2.0:1788865021.086877:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae8753b1-5eef-4af3-91d0-fbf927415401+6:13885:x1875760528862720:12345-192.168.203.13@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788865021.086968:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae8753b1-5eef-4af3-91d0-fbf927415401+6:13885:x1875760528862720:12345-192.168.203.13@tcp:40:mount.lustre.0 Request processed in 94us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865021.086976:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:1.0:1788865021.096972:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865021.097020:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865021.097206:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788865021.097305:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528862848 00000100:00100000:3.0:1788865021.097315:0:14983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528862848 00000100:00100000:3.0:1788865021.097356:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528862976 00000100:00100000:3.0:1788865021.097358:0:14983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528862976 00000100:00100000:3.0:1788865021.097373:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:3.0:1788865021.097379:0:14983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81925880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1875760528862848:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788865021.097421:0:14983:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ae8753b1-5eef-4af3-91d0-fbf927415401@192.168.203.13@tcp t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:3.0:1788865021.097453:0:14983:0:(genops.c:1384:class_connect()) connect: client ae8753b1-5eef-4af3-91d0-fbf927415401, cookie 0xf8c13e2d0e95a5c4 00002000:00100000:3.0:1788865021.097465:0:14983:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ae8753b1-5eef-4af3-91d0-fbf927415401/ffff9fdb82ca6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788865021.097475:0:14983:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788865021.097580:0:14983:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788865021.097612:0:14983:0:(import.c:65:import_set_state_nolock()) ffff9fdb82ca5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788865021.097681:0:14983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81925880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ae8753b1-5eef-4af3-91d0-fbf927415401+6:2355:x1875760528862848:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 301us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865021.097689:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:3.0:1788865021.097737:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1788865021.097742:0:14983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1875760528862976:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788865021.097757:0:14983:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ae8753b1-5eef-4af3-91d0-fbf927415401@192.168.203.13@tcp t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:3.0:1788865021.097777:0:14983:0:(genops.c:1384:class_connect()) connect: client ae8753b1-5eef-4af3-91d0-fbf927415401, cookie 0xf8c13e2d0e95a5cb 00002000:00100000:3.0:1788865021.097782:0:14983:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ae8753b1-5eef-4af3-91d0-fbf927415401/ffff9fdb82ca1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788865021.097798:0:14983:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788865021.097850:0:14983:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788865021.097865:0:14983:0:(import.c:65:import_set_state_nolock()) ffff9fdb82ca2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788865021.097890:0:14983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ae8753b1-5eef-4af3-91d0-fbf927415401+6:2355:x1875760528862976:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 146us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865021.097896:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1788865021.098385:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528863104 00000100:00100000:0.0:1788865021.098391:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528863104 00000100:00100000:0.0:1788865021.098433:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:0.0:1788865021.098441:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ae8753b1-5eef-4af3-91d0-fbf927415401+6:13885:x1875760528863104:12345-192.168.203.13@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788865021.098526:0:14305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788865021.098582:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ae8753b1-5eef-4af3-91d0-fbf927415401+6:13885:x1875760528863104:12345-192.168.203.13@tcp:33:mount.lustre.0 Request processed in 142us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865021.098589:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:2.0:1788865021.253067:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546677760:0@lo:400:kworker.0 00000100:00100000:2.0:1788865021.253145:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788865021.253205:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788865021.253210:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546677888:0@lo:400:kworker.0 00000100:00100000:2.0:1788865021.253236:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788865021.253284:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546677888 00000100:00100000:2.0:1788865021.253292:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546677888 00000100:00100000:2.0:1788865021.253338:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788865021.253346:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546677888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788865021.253394:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546677888:12345-0@lo:400:kworker.0 Request processed in 48us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865021.253415:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788865021.253456:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546677888:0@lo:400:kworker.0 00000100:00100000:2.0:1788865021.253478:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546677760 00000100:00100000:2.0:1788865021.253482:0:14983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546677760 00000100:00100000:2.0:1788865021.253518:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788865021.253525:0:14986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcac9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1875760546677760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788865021.253558:0:14986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcac9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1875760546677760:12345-0@lo:400:kworker.0 Request processed in 34us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865021.253564:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788865021.253587:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546677760:0@lo:400:kworker.0 00000100:00100000:1.0:1788865021.253761:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788865021.253777:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdb81926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546678272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788865021.253805:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788865021.253962:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3300:1875760546677504:0@lo:400:kworker.0 00000100:00100000:3.0:1788865021.253994:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788865021.254028:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546678016:0@lo:400:kworker.0 00000100:00100000:3.0:1788865021.254061:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788865021.254077:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788865021.254084:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546677632:0@lo:400:kworker.0 00000100:00100000:3.0:1788865021.254105:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788865021.254119:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcac9cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546678144:0@lo:400:kworker.0 00000100:00100000:3.0:1788865021.254148:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788865021.254170:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788865021.254181:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546678272 00000100:00100000:3.0:1788865021.254185:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546678272 00000100:00100000:3.0:1788865021.254210:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788865021.254216:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875760546678272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788865021.254231:0:14987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788865021.254265:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875760546678272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865021.254271:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788865021.254418:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546678016 00000100:00100000:2.0:1788865021.254422:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546678016 00000100:00100000:2.0:1788865021.254457:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546678144 00000100:00100000:2.0:1788865021.254460:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546678144 00000100:00100000:2.0:1788865021.254475:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788865021.254481:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546678016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788865021.254517:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546678016:12345-0@lo:400:kworker.0 Request processed in 36us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865021.254524:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788865021.254535:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788865021.254540:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546678144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788865021.254565:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546678144:12345-0@lo:400:kworker.0 Request processed in 25us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865021.254571:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788865021.254603:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546678144:0@lo:400:kworker.0 00000100:00100000:1.0:1788865021.254724:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546677632 00000100:00100000:1.0:1788865021.254728:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546677632 00000100:00100000:1.0:1788865021.254752:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788865021.254758:0:14985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546677632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788865021.254787:0:14985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546677632:12345-0@lo:400:kworker.0 Request processed in 29us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865021.254792:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788865021.254826:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdb81926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546678272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788865021.254862:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546677504 00000100:00100000:1.0:1788865021.254864:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546677504 00000100:00100000:1.0:1788865021.254887:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788865021.254892:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:3300:x1875760546677504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788865021.254922:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:3300:x1875760546677504:12345-0@lo:400:kworker.0 Request processed in 29us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865021.254927:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788865021.255519:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546678016:0@lo:400:kworker.0 00000100:00100000:2.0:1788865021.255546:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546677632:0@lo:400:kworker.0 00000100:00100000:2.0:1788865021.255554:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcac9ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3300:1875760546677504:0@lo:400:kworker.0 00000100:00080000:3.0:1788865021.255609:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788865021.317826:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788865021.344655:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1788865021.344756:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 14989055-e60f-465d-a477-346c1f551105 00000001:00100000:2.0:1788865021.344764:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ae8753b1-5eef-4af3-91d0-fbf927415401 00000001:00100000:2.0:1788865021.344768:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788865021.370297:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865021.370829:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528863232 00000100:00100000:2.0:1788865021.370839:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528863232 00000100:00100000:3.0:1788865021.371217:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:3.0:1788865021.371230:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae8753b1-5eef-4af3-91d0-fbf927415401+6:13917:x1875760528863232:12345-192.168.203.13@tcp:101:mkdir.0 00010000:00010000:3.0:1788865021.371250:0:14300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788865021.371275:0:14300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f000/0xf8c13e2d0e95a5d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975ff6a expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865021.371475:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a5d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865021.371490:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a5d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865021.371520:0:14300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a5d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788865021.371553:0:14300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788865021.371557:0:14300:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788865021.371593:0:14300:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a5d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865021.371633:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f000/0xf8c13e2d0e95a5d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff6a expref: 8 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865021.371653:0:14300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a5d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff6a expref: 7 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865021.371662:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc8399ae00) 00010000:00010000:3.0:1788865021.371665:0:14300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788865021.371669:0:14300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213fc00, rc 0) 00000100:00100000:3.0:1788865021.371777:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae8753b1-5eef-4af3-91d0-fbf927415401+7:13917:x1875760528863232:12345-192.168.203.13@tcp:101:mkdir.0 Request processed in 549us (1489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865021.371785:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00010000:00010000:3.0:1788865022.340802:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788865023.373100:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788865023.375130:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 14989055-e60f-465d-a477-346c1f551105 00000001:00100000:3.0:1788865023.375145:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ae8753b1-5eef-4af3-91d0-fbf927415401 00000001:00100000:0.0:1788865023.887481:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 14989055-e60f-465d-a477-346c1f551105 00000001:00100000:0.0:1788865023.887675:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ae8753b1-5eef-4af3-91d0-fbf927415401 00000001:02000400:1.0:1788865023.927598:0:16264:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788865024.388943:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788865025.349110:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc063bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546678400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788865025.349181:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788865025.349315:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546678400 00000100:00100000:2.0:1788865025.349324:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546678400 00000100:00100000:2.0:1788865025.349390:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788865025.349402:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546678400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788865025.349437:0:14987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788865025.349486:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546678400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865025.349493:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788865025.349534:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc063bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546678400:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788865025.349619:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788865025.414084:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788865026.373306:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc063b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546678784:0@lo:400:kworker.0 00000100:00100000:2.0:1788865026.373375:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788865026.373426:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788865026.373432:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc063ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546678912:0@lo:400:kworker.0 00000100:00100000:2.0:1788865026.373456:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788865026.373502:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546678784 00000100:00100000:2.0:1788865026.373510:0:14986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546678784 00000100:00100000:2.0:1788865026.373566:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788865026.373575:0:14986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546678784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788865026.373624:0:14986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546678784:12345-0@lo:400:kworker.0 Request processed in 50us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865026.373631:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788865026.373654:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546678912 00000100:00100000:2.0:1788865026.373657:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546678912 00000100:00100000:2.0:1788865026.373683:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788865026.373689:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc063a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546678912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788865026.373745:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc063a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875760546678912:12345-0@lo:400:kworker.0 Request processed in 55us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865026.373751:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788865026.373768:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788865026.373803:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc063ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875760546678912:0@lo:400:kworker.0 00000100:00100000:2.0:1788865026.373813:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788865026.373827:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc063b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546678784:0@lo:400:kworker.0 00000100:00100000:1.0:1788865026.376579:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc063b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546678656:0@lo:400:kworker.0 00000100:00100000:3.0:1788865026.376638:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcafca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546679296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788865026.376657:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788865026.377228:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788865026.377301:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546679296 00000100:00100000:3.0:1788865026.377308:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546679296 00000100:00100000:3.0:1788865026.377355:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788865026.377364:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546679296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788865026.377400:0:14987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788865026.377451:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546679296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865026.377458:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788865026.377504:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcafca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546679296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788865026.377601:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc063bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3300:1875760546678528:0@lo:400:kworker.0 00000100:00100000:0.0:1788865026.377646:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788865026.377679:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546679040:0@lo:400:kworker.0 00000100:00100000:0.0:1788865026.377719:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788865026.377752:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546679040 00000100:00100000:0.0:1788865026.377756:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546679040 00000100:00100000:0.0:1788865026.377791:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788865026.377798:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546679040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788865026.377847:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875760546679040:12345-0@lo:400:kworker.0 Request processed in 49us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865026.377853:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788865026.377880:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788865026.377899:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875760546679040:0@lo:400:kworker.0 00000100:00100000:2.0:1788865026.378244:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546678528 00000100:00100000:2.0:1788865026.378250:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546678528 00000100:00100000:2.0:1788865026.378281:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788865026.378289:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:3300:x1875760546678528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788865026.378330:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:3300:x1875760546678528:12345-0@lo:400:kworker.0 Request processed in 43us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865026.378337:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788865026.378551:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc063bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3300:1875760546678528:0@lo:400:kworker.0 00000100:00100000:3.0:1788865026.380022:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546678656 00000100:00100000:3.0:1788865026.381023:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546678656 00000100:00100000:3.0:1788865026.381170:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788865026.381181:0:14985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546678656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788865026.381262:0:14985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546678656:12345-0@lo:400:kworker.0 Request processed in 83us (4606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865026.381268:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788865026.388240:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc063b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546678656:0@lo:400:kworker.0 00000100:00100000:1.0:1788865026.388257:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc063b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875760546679168:0@lo:400:kworker.0 00000100:00100000:1.0:1788865026.388315:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788865026.388369:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546679168 00000100:00100000:3.0:1788865026.388378:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546679168 00000100:00100000:3.0:1788865026.388478:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788865026.388488:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875760546679168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788865026.388541:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875760546679168:12345-0@lo:400:kworker.0 Request processed in 55us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865026.388548:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788865026.388598:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788865026.388926:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc063b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875760546679168:0@lo:400:kworker.0 00010000:00010000:2.0:1788865026.439354:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788865026.450816:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865026.450854:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865026.450882:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865026.450901:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865026.450918:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865026.450946:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865026.450973:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865026.451017:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528863360 00000100:00100000:0.0:1788865026.451026:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528863360 00000100:00100000:0.0:1788865026.451076:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 105 00000100:00100000:0.0:1788865026.451095:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e4b30ef-707f-4a68-abf9-d500481ae7c8+13:2358:x1875760528863360:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788865026.451164:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e4b30ef-707f-4a68-abf9-d500481ae7c8+13:2358:x1875760528863360:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 78us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865026.451173:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 105 00000100:00100000:3.0:1788865026.451183:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528863872 00000100:00100000:3.0:1788865026.451196:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528863872 00000100:00100000:0.0:1788865026.451209:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528863616 00000100:00100000:0.0:1788865026.451215:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528863616 00000100:00100000:0.0:1788865026.451244:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528864128 00000100:00100000:0.0:1788865026.451248:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528864128 00000100:00100000:0.0:1788865026.451271:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528863744 00000100:00100000:0.0:1788865026.451274:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528863744 00000100:00100000:0.0:1788865026.451292:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528864000 00000100:00100000:0.0:1788865026.451295:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528864000 00000100:00100000:0.0:1788865026.451319:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:0.0:1788865026.451328:0:14985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14989055-e60f-465d-a477-346c1f551105+5:2358:x1875760528863616:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788865026.451353:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528863488 00000100:00100000:3.0:1788865026.451358:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528863488 00000100:00100000:0.0:1788865026.451370:0:14985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14989055-e60f-465d-a477-346c1f551105+5:2358:x1875760528863616:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 42us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865026.451379:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:3.0:1788865026.451387:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:3.0:1788865026.451398:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae8753b1-5eef-4af3-91d0-fbf927415401+6:2358:x1875760528863872:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788865026.451401:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:0.0:1788865026.451415:0:14985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ae8753b1-5eef-4af3-91d0-fbf927415401+5:2358:x1875760528864128:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788865026.451440:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae8753b1-5eef-4af3-91d0-fbf927415401+6:2358:x1875760528863872:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 44us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865026.451447:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:0.0:1788865026.451461:0:14985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ae8753b1-5eef-4af3-91d0-fbf927415401+5:2358:x1875760528864128:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 48us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865026.451463:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:3.0:1788865026.451476:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14989055-e60f-465d-a477-346c1f551105+6:2358:x1875760528863488:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788865026.451477:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:0.0:1788865026.451498:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:3.0:1788865026.451510:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14989055-e60f-465d-a477-346c1f551105+6:2358:x1875760528863488:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 35us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865026.451511:0:14985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14989055-e60f-465d-a477-346c1f551105+5:2358:x1875760528863744:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788865026.451524:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:0.0:1788865026.451546:0:14985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14989055-e60f-465d-a477-346c1f551105+5:2358:x1875760528863744:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 40us (598us total) trans 0 rc 0/0 00000100:00080000:3.0:1788865026.451550:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788865026.451555:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00080000:3.0:1788865026.451557:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788865026.451561:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788865026.451574:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:0.0:1788865026.451582:0:14985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ae8753b1-5eef-4af3-91d0-fbf927415401+5:2358:x1875760528864000:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788865026.451604:0:14985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ae8753b1-5eef-4af3-91d0-fbf927415401+5:2358:x1875760528864000:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865026.451610:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000040:00080000:2.0:1788865026.757450:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:3.0:1788865027.220256:0:16412:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd280e03b0 20000000:00000080:3.0:1788865027.220273:0:16412:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fdcad10c000 uarg=0000000000000000 20000000:01000000:3.0:1788865027.220312:0:16412:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788865027.220317:0:16412:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788865027.220321:0:16412:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788865027.221856:0:16413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1788865027.222403:0:16412:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788865027.228970:0:16412:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788865027.229056:0:16412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e95a5e0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865027.229076:0:16412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdcc2044000/0xf8c13e2d0e95a2d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a2d0 expref: 18 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865027.229114:0:16412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdcafc74c00/0xf8c13e2d0e95a324 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a31d expref: 18 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865027.229121:0:16412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdcc2045600/0xf8c13e2d0e95a458 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a451 expref: 18 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865027.229130:0:16412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdcb5384a00/0xf8c13e2d0e95a57e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fede expref: 12 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865027.229137:0:16412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fdcb5384600/0xf8c13e2d0e95a5b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff40 expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865027.229145:0:16412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e95a5e0 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865027.229190:0:16412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdcb5384600/0xf8c13e2d0e95a5b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff40 expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865027.229207:0:16412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fdcb5384600/0xf8c13e2d0e95a5b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff40 expref: 12 pid: 14296 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865027.229222:0:16412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcafca1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16412:1875760546679424:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788865027.229323:0:16412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdcb5384a00/0xf8c13e2d0e95a57e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fede expref: 12 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865027.229332:0:16412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fdcb5384a00/0xf8c13e2d0e95a57e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fede expref: 12 pid: 14293 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865027.229341:0:16412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcafca0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16412:1875760546679552:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788865027.229381:0:16412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdcc2045600/0xf8c13e2d0e95a458 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e95a451 expref: 18 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865027.229388:0:16412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fdcc2045600/0xf8c13e2d0e95a458 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a451 expref: 18 pid: 14296 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865027.229398:0:16412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcafca2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16412:1875760546679680:0@lo:104: 00000100:00100000:3.0:1788865027.229436:0:16412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788865027.229538:0:16412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdcafc74c00/0xf8c13e2d0e95a324 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e95a31d expref: 18 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865027.229546:0:16412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fdcafc74c00/0xf8c13e2d0e95a324 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a31d expref: 18 pid: 14296 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865027.229553:0:16412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86ebb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16412:1875760546679808:0@lo:104: 00000100:00100000:3.0:1788865027.229575:0:16412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788865027.229737:0:16412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fdcc2044000/0xf8c13e2d0e95a2d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf8c13e2d0e95a2d0 expref: 18 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865027.229745:0:16412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fdcc2044000/0xf8c13e2d0e95a2d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a2d0 expref: 18 pid: 14295 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865027.229753:0:16412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16412:1875760546679936:0@lo:104: 00000100:00100000:3.0:1788865027.229778:0:16412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788865027.229862:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546679680 00000100:00100000:2.0:1788865027.229870:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546679680 00000100:00100000:2.0:1788865027.229908:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546679808 00000100:00100000:2.0:1788865027.229911:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546679808 00000100:00100000:2.0:1788865027.229925:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788865027.229934:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+4:16412:x1875760546679680:12345-0@lo:104: 00010000:00010000:2.0:1788865027.229945:0:14284:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdcafc74600/0xf8c13e2d0e95a451 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e95a458 expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865027.230013:0:14284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788865027.230019:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+4:16412:x1875760546679680:12345-0@lo:104: Request processed in 86us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865027.230026:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788865027.230042:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788865027.230048:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+3:16412:x1875760546679808:12345-0@lo:104: 00010000:00010000:2.0:1788865027.230056:0:14284:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a31d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e95a324 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865027.230100:0:14284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788865027.230105:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+3:16412:x1875760546679808:12345-0@lo:104: Request processed in 58us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865027.230111:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788865027.230128:0:16051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788865027.230133:0:16051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdcafc74600/0xf8c13e2d0e95a451 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e95a458 expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865027.230139:0:16051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74600 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1788865027.230142:0:16051:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdcafc74600/0xf8c13e2d0e95a451 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e95a458 expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865027.230157:0:16051:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdcafc74600/0xf8c13e2d0e95a451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e95a458 expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788865027.230163:0:16051:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdcafc74600/0xf8c13e2d0e95a451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e95a458 expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788865027.230168:0:16051:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788865027.230196:0:16051:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdcafc74600/0xf8c13e2d0e95a451 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95a458 expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865027.230201:0:16051:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788865027.230220:0:16051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdcafc74600/0xf8c13e2d0e95a451 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95a458 expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865027.230226:0:16051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdcafc74600/0xf8c13e2d0e95a451 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95a458 expref: -99 pid: 15701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865027.230239:0:16051:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788865027.230242:0:16051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a31d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e95a324 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865027.230247:0:16051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdca2d4ba00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1788865027.230249:0:16051:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a31d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e95a324 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865027.230254:0:16051:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a31d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e95a324 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788865027.230259:0:16051:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a31d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e95a324 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788865027.230271:0:16051:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788865027.230285:0:16051:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a31d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95a324 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865027.230291:0:16051:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788865027.230305:0:16051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a31d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95a324 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865027.230312:0:16051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdca2d4ba00/0xf8c13e2d0e95a31d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95a324 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865027.230322:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788865027.230324:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788865027.230325:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788865027.230331:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788865027.230350:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc063b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3303:1875760546680064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788865027.230379:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788865027.230418:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc063ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3300:1875760546680192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788865027.230440:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788865027.230470:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546680064 00000100:00100000:2.0:1788865027.230474:0:14287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546680064 00010000:00010000:2.0:1788865027.230490:0:14287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdcc2045600/0xf8c13e2d0e95a458 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a451 expref: 19 pid: 14296 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788865027.230508:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546680192 00000100:00100000:2.0:1788865027.230511:0:14287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546680192 00010000:00010000:2.0:1788865027.230522:0:14287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdcafc74c00/0xf8c13e2d0e95a324 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a31d expref: 20 pid: 14296 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788865027.230544:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788865027.230549:0:14287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0639c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+20:3303:x1875760546680064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788865027.230558:0:14287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788865027.230564:0:14287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdcc2045600/0xf8c13e2d0e95a458 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a451 expref: 20 pid: 14296 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865027.230572:0:14287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdcc2045600/0xf8c13e2d0e95a458 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a451 expref: 20 pid: 14296 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865027.230585:0:14287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788865027.230612:0:14287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0639c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+20:3303:x1875760546680064:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865027.230618:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788865027.230632:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788865027.230638:0:14287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0639f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:3300:x1875760546680192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788865027.230645:0:14287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788865027.230649:0:14287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdcafc74c00/0xf8c13e2d0e95a324 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a31d expref: 19 pid: 14296 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865027.230657:0:14287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdcafc74c00/0xf8c13e2d0e95a324 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a31d expref: 19 pid: 14296 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865027.230665:0:14287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788865027.230688:0:14287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0639f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:3300:x1875760546680192:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865027.230695:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788865027.230750:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc063ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3300:1875760546680192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788865027.230783:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc063b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3303:1875760546680064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788865027.232155:0:16412:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca04dccc0 going to sleep for 11 seconds 00010000:00010000:3.0:1788865027.232182:0:16412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcc2045600/0xf8c13e2d0e95a458 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e95a451 expref: 18 pid: 14296 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865027.232198:0:16412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcafca2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16412:1875760546679680:0@lo:104: 00010000:00010000:3.0:1788865027.232208:0:16412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcafc74c00/0xf8c13e2d0e95a324 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e95a31d expref: 17 pid: 14296 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865027.232229:0:16412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86ebb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16412:1875760546679808:0@lo:104: 00000100:00100000:3.0:1788865027.232814:0:14284:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788865027.232837:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546679936 00000100:00100000:3.0:1788865027.232844:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546679936 00000100:00100000:3.0:1788865027.232882:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788865027.232890:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc051a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+3:16412:x1875760546679936:12345-0@lo:104: 00010000:00010000:3.0:1788865027.232904:0:14284:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e95a2d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e95a2d7 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865027.232967:0:14284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788865027.232973:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc051a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+3:16412:x1875760546679936:12345-0@lo:104: Request processed in 83us (3193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865027.232980:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788865027.233038:0:16412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16412:1875760546679936:0@lo:104: 00010000:00010000:2.0:1788865027.233212:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788865027.233219:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e95a2d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf8c13e2d0e95a2d7 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865027.233225:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75c00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1788865027.233230:0:14289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e95a2d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf8c13e2d0e95a2d7 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865027.233237:0:14289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e95a2d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf8c13e2d0e95a2d7 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788865027.233243:0:14289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e95a2d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf8c13e2d0e95a2d7 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788865027.233248:0:14289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788865027.233288:0:14289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e95a2d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95a2d7 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865027.233293:0:14289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788865027.233309:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e95a2d0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95a2d7 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865027.233315:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9fdcafc75c00/0xf8c13e2d0e95a2d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf8c13e2d0e95a2d7 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865027.233330:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788865027.233332:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788865027.233334:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788865027.233345:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc063b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3301:1875760546680320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788865027.233391:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788865027.233433:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546680320 00000100:00100000:2.0:1788865027.233437:0:14287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546680320 00010000:00010000:2.0:1788865027.233455:0:14287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdcc2044000/0xf8c13e2d0e95a2d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a2d0 expref: 17 pid: 14295 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788865027.233473:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788865027.233479:0:14287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc14cb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+17:3301:x1875760546680320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788865027.233489:0:14287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788865027.233494:0:14287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdcc2044000/0xf8c13e2d0e95a2d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a2d0 expref: 17 pid: 14295 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865027.233502:0:14287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdcc2044000/0xf8c13e2d0e95a2d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf8c13e2d0e95a2d0 expref: 17 pid: 14295 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865027.233514:0:14287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcc2044000/0xf8c13e2d0e95a2d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf8c13e2d0e95a2d0 expref: 17 pid: 14295 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865027.233526:0:14287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788865027.233551:0:14287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc14cb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:3301:x1875760546680320:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865027.233557:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788865027.234382:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788865027.234448:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865027.235064:0:16412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcafca1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16412:1875760546679424:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788865027.235074:0:16412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcafca0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16412:1875760546679552:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788865027.235120:0:16412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e95a5e0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788865027.238747:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528864256 00000100:00100000:1.0:1788865027.238762:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528864256 00010000:00010000:1.0:1788865027.238803:0:14286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdcb5384600/0xf8c13e2d0e95a5b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff40 expref: 13 pid: 14296 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788865027.238828:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528864384 00000100:00100000:1.0:1788865027.238831:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528864384 00010000:00010000:1.0:1788865027.238842:0:14286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fdcb5384a00/0xf8c13e2d0e95a57e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fede expref: 14 pid: 14293 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788865027.238856:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1788865027.238865:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b30ef-707f-4a68-abf9-d500481ae7c8+14:2359:x1875760528864256:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788865027.238879:0:14286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788865027.238884:0:14286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdcb5384600/0xf8c13e2d0e95a5b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff40 expref: 14 pid: 14296 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865027.238896:0:14286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdcb5384600/0xf8c13e2d0e95a5b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff40 expref: 14 pid: 14296 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865027.238913:0:14286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcb5384600/0xf8c13e2d0e95a5b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff40 expref: 14 pid: 14296 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865027.238924:0:14286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788865027.238977:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b30ef-707f-4a68-abf9-d500481ae7c8+13:2359:x1875760528864256:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 112us (4598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865027.239356:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1788865027.239376:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:1.0:1788865027.239394:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b30ef-707f-4a68-abf9-d500481ae7c8+12:2358:x1875760528864384:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788865027.239403:0:14286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788865027.239408:0:14286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fdcb5384a00/0xf8c13e2d0e95a57e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fede expref: 12 pid: 14293 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865027.239418:0:14286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fdcb5384a00/0xf8c13e2d0e95a57e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fede expref: 12 pid: 14293 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865027.239428:0:14286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdcb5384a00/0xf8c13e2d0e95a57e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fede expref: 12 pid: 14293 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865027.239440:0:14286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e95a5e0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865027.239448:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e95a5e0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865027.239462:0:14286:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e95a5e0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865027.239470:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e95a5e0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865027.239476:0:14286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e95a5e0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865027.239483:0:14286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e95a5e0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865027.239490:0:14286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213e400 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865027.239494:0:14286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e95a5e0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865027.239509:0:14286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e95a5e0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788865027.239644:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc063b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3301:1875760546680320:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788865027.240329:0:16412:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e95a5e0 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865027.240340:0:16412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e95a5e0 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865027.241168:0:14286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e95a5e0 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865027.241183:0:14286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fdb8213e400/0xf8c13e2d0e95a5e0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865027.245199:0:14286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788865027.245323:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b30ef-707f-4a68-abf9-d500481ae7c8+11:2358:x1875760528864384:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 5923us (10868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865027.245335:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00010000:00010000:2.0:1788865027.461032:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865028.485478:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788865028.742023:0:14298:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788865028.742031:0:14298:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fdc82ac3800 from 10 10000000:01000000:0.0:1788865028.742036:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788865028.742094:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcbd0c7400/0xf8c13e2d0e95a5e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865028.742106:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdcbd0c7400/0xf8c13e2d0e95a5e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865028.742116:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdcbd0c7400/0xf8c13e2d0e95a5e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788865028.742139:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc9f45df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546680448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788865028.742207:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788865028.742297:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdcacbe0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788865028.743408:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546680448 00000100:00100000:1.0:1788865028.743421:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546680448 00000100:00100000:1.0:1788865028.743483:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788865028.743492:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+16:14298:x1875760546680448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788865028.743509:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788865028.743535:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcafc74000/0xf8c13e2d0e95a5ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95a5e7 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865028.743560:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcafc74000/0xf8c13e2d0e95a5ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a5e7 expref: 17 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865028.743571:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcafc74000/0xf8c13e2d0e95a5ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a5e7 expref: 17 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865028.743580:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc74000, rc 0) 00000100:00100000:1.0:1788865028.743727:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+17:14298:x1875760546680448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 235us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865028.743733:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788865028.744507:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc9f45df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546680448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788865028.744694:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdcbd0c7400/0xf8c13e2d0e95a5e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a5ee expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865028.745032:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdcbd0c7400/0xf8c13e2d0e95a5e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95a5ee expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788865028.745206:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc063b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546680576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788865028.745256:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788865028.745325:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc873c1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788865028.745360:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546680576 00000100:00100000:0.0:1788865028.745365:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546680576 00000100:00100000:0.0:1788865028.745431:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788865028.745440:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+17:14298:x1875760546680576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788865028.745698:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+17:14298:x1875760546680576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865028.745783:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788865028.745922:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc063b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546680576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788865028.745963:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc063b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546680704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788865028.745999:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788865028.746332:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc873c1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788865028.746368:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546680704 00000100:00100000:1.0:1788865028.746374:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546680704 00000100:00100000:3.0:1788865028.746410:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788865028.746420:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+17:14298:x1875760546680704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788865028.746590:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+17:14298:x1875760546680704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865028.746597:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788865028.746729:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc063b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546680704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788865028.747625:0:16482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788865028.747980:0:14298:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788865028.748008:0:14298:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788865028.748018:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdcbd0c7400/0xf8c13e2d0e95a5e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a5ee expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865028.748030:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdcbd0c7400/0xf8c13e2d0e95a5e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a5ee expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788865028.748040:0:14298:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788865028.748042:0:14298:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fdc8339a000 from 10 10000000:01000000:3.0:1788865028.748045:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788865028.748085:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fe00/0xf8c13e2d0e95a5f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865028.748093:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fe00/0xf8c13e2d0e95a5f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865028.748102:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fe00/0xf8c13e2d0e95a5f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865028.748121:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546680832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788865028.748167:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788865028.748213:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca2e7de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788865028.748264:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546680832 00000100:00100000:0.0:1788865028.748270:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546680832 00000100:00100000:0.0:1788865028.748305:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788865028.748312:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+17:14298:x1875760546680832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788865028.748332:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788865028.748345:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcbd0c6e00/0xf8c13e2d0e95a5fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95a5f5 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865028.748366:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcbd0c6e00/0xf8c13e2d0e95a5fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a5f5 expref: 18 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865028.748375:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcbd0c6e00/0xf8c13e2d0e95a5fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a5f5 expref: 18 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865028.748382:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcbd0c6e00, rc 0) 00000100:00100000:0.0:1788865028.748424:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+18:14298:x1875760546680832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865028.748430:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788865028.748495:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546680832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788865028.748508:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fe00/0xf8c13e2d0e95a5f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a5fc expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865028.748530:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fe00/0xf8c13e2d0e95a5f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95a5fc expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865028.748573:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546680960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788865028.748598:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788865028.748618:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca2e7de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788865028.748887:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546680960 00000100:00100000:0.0:1788865028.748892:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546680960 00000100:00100000:0.0:1788865028.748910:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788865028.748915:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+18:14298:x1875760546680960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788865028.749151:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+18:14298:x1875760546680960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865028.749158:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788865028.749236:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546680960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788865028.749263:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546681088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788865028.749304:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788865028.749334:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca2e7de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788865028.749372:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546681088 00000100:00100000:0.0:1788865028.749376:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546681088 00000100:00100000:0.0:1788865028.749393:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788865028.749399:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+18:14298:x1875760546681088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788865028.749549:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+18:14298:x1875760546681088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865028.749565:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788865028.749740:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546681088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788865028.752236:0:16483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788865028.752452:0:14298:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788865028.752474:0:14298:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788865028.752495:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fe00/0xf8c13e2d0e95a5f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a5fc expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865028.752508:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fe00/0xf8c13e2d0e95a5f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a5fc expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788865028.752518:0:14298:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788865028.752521:0:14298:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fdb812fc800 from 10 10000000:01000000:3.0:1788865028.752524:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788865028.752567:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fa00/0xf8c13e2d0e95a603 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865028.752575:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fa00/0xf8c13e2d0e95a603 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865028.752584:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fa00/0xf8c13e2d0e95a603 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865028.752610:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546681216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788865028.752667:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788865028.752730:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca2e7de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788865028.752884:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546681216 00000100:00100000:2.0:1788865028.752892:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546681216 00000100:00100000:2.0:1788865028.755110:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788865028.755134:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+18:14298:x1875760546681216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788865028.755153:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788865028.755172:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcb5384000/0xf8c13e2d0e95a60a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8c13e2d0e95a603 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865028.755199:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcb5384000/0xf8c13e2d0e95a60a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a603 expref: 19 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865028.755211:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcb5384000/0xf8c13e2d0e95a60a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf8c13e2d0e95a603 expref: 19 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865028.755219:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384000, rc 0) 00000100:00100000:2.0:1788865028.755296:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:14298:x1875760546681216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (2628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865028.755303:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788865028.761413:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546681216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788865028.761444:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fa00/0xf8c13e2d0e95a603 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a60a expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865028.761457:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fa00/0xf8c13e2d0e95a603 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf8c13e2d0e95a60a expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865028.761608:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546681344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788865028.761667:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788865028.761958:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546681344 00000100:00100000:1.0:1788865028.761964:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546681344 00000100:00100000:1.0:1788865028.762003:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788865028.762011:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:14298:x1875760546681344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788865028.762248:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:14298:x1875760546681344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865028.762256:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788865028.762363:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca2e7de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788865028.762379:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546681344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788865028.762408:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546681472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788865028.762449:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788865028.762511:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca2e7de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788865028.768766:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546681472 00000100:00100000:0.0:1788865028.768910:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546681472 00000100:00100000:0.0:1788865028.768968:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788865028.768978:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc2a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:14298:x1875760546681472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788865028.769236:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc2a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:14298:x1875760546681472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 259us (6785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865028.769244:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788865028.769352:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:14298:1875760546681472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788865028.776590:0:16485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788865028.776852:0:14298:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788865028.776874:0:14298:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788865028.776889:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fa00/0xf8c13e2d0e95a603 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a60a expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865028.776911:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9fdb8213fa00/0xf8c13e2d0e95a603 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf8c13e2d0e95a60a expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788865029.268700:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865029.271360:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528864512 00000100:00100000:1.0:1788865029.271374:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528864512 00000100:00100000:1.0:1788865029.271432:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:1.0:1788865029.271443:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e4b30ef-707f-4a68-abf9-d500481ae7c8+11:13769:x1875760528864512:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788865029.271460:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788865029.271479:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcafc75400/0xf8c13e2d0e95a611 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c2384dba975ff71 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865029.271506:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcafc75400/0xf8c13e2d0e95a611 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff71 expref: 12 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865029.271517:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcafc75400/0xf8c13e2d0e95a611 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff71 expref: 12 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865029.271526:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc75400, rc 0) 00000100:00100000:1.0:1788865029.271731:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e4b30ef-707f-4a68-abf9-d500481ae7c8+12:13769:x1875760528864512:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 288us (3036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865029.271746:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:0.0:1788865029.285258:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865029.285323:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528864640 00000100:00100000:1.0:1788865029.285334:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528864640 00000100:00100000:1.0:1788865029.285387:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:1.0:1788865029.285398:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+12:13769:x1875760528864640:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788865029.286604:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+12:13769:x1875760528864640:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 1202us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865029.286615:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:0.0:1788865029.296927:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865029.302470:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528864768 00000100:00100000:1.0:1788865029.302484:0:14293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528864768 00000100:00100000:1.0:1788865029.302546:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:1.0:1788865029.302812:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e4b30ef-707f-4a68-abf9-d500481ae7c8+12:13769:x1875760528864768:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788865029.303038:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e4b30ef-707f-4a68-abf9-d500481ae7c8+12:13769:x1875760528864768:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 230us (6120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865029.303046:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:2.0:1788865029.307331:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865029.307404:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528864896 00000100:00100000:1.0:1788865029.307414:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528864896 00000100:00100000:1.0:1788865029.307468:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:1.0:1788865029.307478:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+12:13769:x1875760528864896:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788865029.307494:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788865029.307511:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fdcafc75200/0xf8c13e2d0e95a618 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c2384dba975ff78 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865029.307538:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fdcafc75200/0xf8c13e2d0e95a618 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff78 expref: 13 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865029.307579:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fdcafc75200/0xf8c13e2d0e95a618 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff78 expref: 13 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865029.307588:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc75200, rc 0) 00000100:00100000:1.0:1788865029.308060:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+13:13769:x1875760528864896:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 581us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865029.308105:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:3.0:1788865029.318391:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865029.318619:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528865024 00000100:00100000:0.0:1788865029.318629:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528865024 00000100:00100000:0.0:1788865029.318690:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:0.0:1788865029.318700:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e4b30ef-707f-4a68-abf9-d500481ae7c8+13:13769:x1875760528865024:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788865029.319003:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e4b30ef-707f-4a68-abf9-d500481ae7c8+13:13769:x1875760528865024:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 303us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865029.319012:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:2.0:1788865029.324232:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865029.324390:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528865152 00000100:00100000:1.0:1788865029.324400:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528865152 00000100:00100000:0.0:1788865029.324463:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:0.0:1788865029.324476:0:14293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e4b30ef-707f-4a68-abf9-d500481ae7c8+13:13769:x1875760528865152:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788865029.324732:0:14293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e4b30ef-707f-4a68-abf9-d500481ae7c8+13:13769:x1875760528865152:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 258us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865029.324741:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 120 00010000:00010000:2.0:1788865029.508907:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788865030.447991:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788865030.448150:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528865280 00000100:00100000:3.0:1788865030.448160:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528865280 00000100:00100000:3.0:1788865030.448239:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:3.0:1788865030.448249:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc063b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14989055-e60f-465d-a477-346c1f551105+6:14428:x1875760528865280:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788865030.448270:0:14300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1788865030.448277:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788865030.448289:0:14300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e95a61f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975ff7f expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.448349:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a626 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.448363:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a626 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.448374:0:14300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a626 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.448527:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e200/0xf8c13e2d0e95a62d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.448536:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e200/0xf8c13e2d0e95a62d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.448542:0:14300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e200/0xf8c13e2d0e95a62d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.448862:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95a634 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.448881:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95a634 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.448889:0:14300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95a634 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788865030.448911:0:14300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788865030.448914:0:14300:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788865030.448947:0:14300:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95a634 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.448958:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a626 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.448965:0:14300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a626 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.448972:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a626 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.448978:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213e400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788865030.448982:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a626 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.448989:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a626 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.448999:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc8399ae00) 00010000:00010000:3.0:1788865030.449002:0:14300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788865030.449007:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a626 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.449022:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a626 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.449034:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e200/0xf8c13e2d0e95a62d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.449039:0:14300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e200/0xf8c13e2d0e95a62d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.449047:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e200/0xf8c13e2d0e95a62d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.449053:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213e200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788865030.449056:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e200/0xf8c13e2d0e95a62d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.449072:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e200/0xf8c13e2d0e95a62d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.449081:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9fdc834b8400) 00010000:00010000:3.0:1788865030.449083:0:14300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788865030.449086:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e200/0xf8c13e2d0e95a62d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.449091:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e200/0xf8c13e2d0e95a62d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.449123:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e95a61f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff7f expref: 8 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.449151:0:14300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f600/0xf8c13e2d0e95a634 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff7f expref: 7 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.449158:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fdc834b8000) 00010000:00010000:3.0:1788865030.449160:0:14300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788865030.449162:0:14300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213f600, rc 0) 00000100:00100000:3.0:1788865030.449571:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc063b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14989055-e60f-465d-a477-346c1f551105+7:14428:x1875760528865280:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1322us (1587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865030.449580:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:3.0:1788865030.467883:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865030.468079:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528865536 00000100:00100000:0.0:1788865030.468110:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528865536 00000100:00100000:0.0:1788865030.468185:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1788865030.468198:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14989055-e60f-465d-a477-346c1f551105+7:14428:x1875760528865536:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788865030.468224:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788865030.468249:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7000/0xf8c13e2d0e95a63b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975ff86 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.468345:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a642 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.468363:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a642 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.468376:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a642 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.470860:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a649 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.470885:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a649 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.470900:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a649 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788865030.471383:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546681600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788865030.471494:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788865030.471615:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7800/0xf8c13e2d0e95a650 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.471628:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7800/0xf8c13e2d0e95a650 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.471636:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7800/0xf8c13e2d0e95a650 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788865030.471653:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00000100:00100000:1.0:1788865030.471778:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546681600 00000100:00100000:1.0:1788865030.471789:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546681600 00000100:00100000:1.0:1788865030.471874:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788865030.471885:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0639c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546681600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788865030.472002:0:14987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788865030.472079:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0639c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546681600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 195us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865030.472087:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788865030.472156:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546681600:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788865030.472301:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788865030.472497:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a642 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.472508:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a642 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.472516:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a642 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.472523:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcbd0c7c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788865030.472527:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a642 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.472533:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a642 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.472546:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fdc834b8000) 00010000:00010000:0.0:1788865030.472549:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788865030.473021:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a642 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.473030:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a642 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.473064:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a649 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.473071:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a649 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.473088:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a649 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.473093:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcbd0c6c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788865030.473096:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a649 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.473103:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a649 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.473112:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fdc8399a000) 00010000:00010000:0.0:1788865030.473114:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788865030.473117:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a649 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.473122:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a649 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.473782:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7000/0xf8c13e2d0e95a63b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff86 expref: 10 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.473804:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7800/0xf8c13e2d0e95a650 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff86 expref: 9 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.473811:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fdc8399a900) 00010000:00010000:0.0:1788865030.473814:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788865030.473819:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcbd0c7800, rc 0) 00000100:00100000:0.0:1788865030.473889:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14989055-e60f-465d-a477-346c1f551105+9:14428:x1875760528865536:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 5693us (6021us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788865030.473908:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:2.0:1788865030.478015:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788865030.478280:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528865664 00000100:00100000:3.0:1788865030.478294:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528865664 00000100:00100000:3.0:1788865030.478371:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:3.0:1788865030.478384:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14989055-e60f-465d-a477-346c1f551105+9:14428:x1875760528865664:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788865030.478522:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14989055-e60f-465d-a477-346c1f551105+9:14428:x1875760528865664:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 Request processed in 141us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865030.478530:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:2.0:1788865030.511519:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865030.511679:0:15714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528865792 00000100:00100000:0.0:1788865030.511693:0:15714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528865792 00000100:00100000:0.0:1788865030.511801:0:15714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:0.0:1788865030.511812:0:15714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc063ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14989055-e60f-465d-a477-346c1f551105+9:14434:x1875760528865792:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788865030.511837:0:15714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788865030.511861:0:15714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7000/0xf8c13e2d0e95a65e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975ff8d expref: -99 pid: 15714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.511936:0:15714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a665 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.511953:0:15714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a665 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.511965:0:15714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a665 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.511980:0:15714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a66c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.511998:0:15714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a66c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.512006:0:15714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a66c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.512458:0:15714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a665 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.512477:0:15714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a665 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.512484:0:15714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a665 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.512491:0:15714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcbd0c6c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788865030.512496:0:15714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a665 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.512504:0:15714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a665 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.512518:0:15714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc8399ae00) 00010000:00010000:0.0:1788865030.512521:0:15714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788865030.512527:0:15714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a665 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.512533:0:15714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a665 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.512546:0:15714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a66c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.512551:0:15714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a66c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.512557:0:15714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a66c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.512631:0:15714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcbd0c7c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788865030.512642:0:15714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a66c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.512649:0:15714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a66c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.512658:0:15714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fdc8399a000) 00010000:00010000:0.0:1788865030.512661:0:15714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788865030.512664:0:15714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a66c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.512670:0:15714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a66c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.512771:0:15714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7000/0xf8c13e2d0e95a65e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff8d expref: 10 pid: 15714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.512782:0:15714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc8399ae00) 00010000:00010000:0.0:1788865030.512784:0:15714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788865030.512788:0:15714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7000/0xf8c13e2d0e95a65e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff8d expref: 10 pid: 15714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.512798:0:15714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcbd0c7000, rc 0) 00000100:00100000:0.0:1788865030.512877:0:15714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc063ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14989055-e60f-465d-a477-346c1f551105+9:14434:x1875760528865792:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1067us (1373us total) trans 0 rc 301/301 00000100:00100000:0.0:1788865030.512886:0:15714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:2.0:1788865030.521551:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865030.526789:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528865920 00000100:00100000:1.0:1788865030.526811:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528865920 00000100:00100000:1.0:1788865030.526884:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:1.0:1788865030.526896:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:14989055-e60f-465d-a477-346c1f551105+9:14434:x1875760528865920:12345-192.168.203.13@tcp:700:lfs.0 00000100:00100000:1.0:1788865030.527016:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:14989055-e60f-465d-a477-346c1f551105+9:14434:x1875760528865920:12345-192.168.203.13@tcp:700:lfs.0 Request processed in 122us (5480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865030.527043:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:1.0:1788865030.530869:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788865030.531163:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528866176 00000100:00100000:3.0:1788865030.531176:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528866176 00000100:00100000:3.0:1788865030.531254:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:3.0:1788865030.531267:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14989055-e60f-465d-a477-346c1f551105+9:14434:x1875760528866176:12345-192.168.203.13@tcp:36:lfs.0 00010000:00010000:3.0:1788865030.531344:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788865030.531378:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7e00/0xf8c13e2d0e95a5a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff08 expref: 9 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.531425:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc8399ae00) 00010000:00010000:3.0:1788865030.531432:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788865030.531986:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e95a673 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.534091:0:14303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a5d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff6a expref: 5 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.534105:0:14303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e95a673 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.534167:0:14303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a5d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff6a expref: 5 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.534183:0:14303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a5d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff6a expref: 5 pid: 14300 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865030.534203:0:14303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdc86eb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14303:1875760546681728:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788865030.534513:0:14303:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc873336c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788865030.536200:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788865030.547020:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865030.548204:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528866304 00000100:00100000:0.0:1788865030.548232:0:14288:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528866304 00010000:00010000:0.0:1788865030.548315:0:14288:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a5d9 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff6a expref: 6 pid: 14300 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788865030.548391:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:0.0:1788865030.548403:0:14288:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0639880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae8753b1-5eef-4af3-91d0-fbf927415401+6:2358:x1875760528866304:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788865030.548434:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788865030.548442:0:14288:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a5d9 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff6a expref: 6 pid: 14300 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.548456:0:14288:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a5d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff6a expref: 6 pid: 14300 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.548483:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc8399ae00) 00010000:00010000:0.0:1788865030.548489:0:14288:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e95a673 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.548499:0:14288:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e95a673 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.548507:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e95a673 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.548531:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788865030.548617:0:14288:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0639880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae8753b1-5eef-4af3-91d0-fbf927415401+6:2358:x1875760528866304:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 216us (1609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865030.548624:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00080000:1.0:1788865030.550234:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788865030.554761:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a5d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff6a expref: 5 pid: 14300 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865030.555116:0:14303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdc86eb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14303:1875760546681728:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788865030.555156:0:14303:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e95a673 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.555169:0:14303:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e95a673 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.555199:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e95a673 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.555231:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e200/0xf8c13e2d0e95a67a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.555247:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e200/0xf8c13e2d0e95a67a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.555259:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e200/0xf8c13e2d0e95a67a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788865030.558414:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788865030.558439:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e95a673 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.558452:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e95a673 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.558461:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e95a673 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.558468:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213f400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788865030.558473:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e95a673 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.558481:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e95a673 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.558504:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc8399ae00) 00010000:00010000:3.0:1788865030.558507:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788865030.558523:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e95a673 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.558531:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f400/0xf8c13e2d0e95a673 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788865030.558625:0:14303:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004527e6af reply state 000000008c4b5cd2 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e200/0xf8c13e2d0e95a67a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865030.558636:0:14303:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788865030.562097:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14989055-e60f-465d-a477-346c1f551105+10:14434:x1875760528866176:12345-192.168.203.13@tcp:36:lfs.0 Request processed in 30814us (31223us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788865030.562114:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00010000:00010000:1.0:1788865030.566553:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e200/0xf8c13e2d0e95a67a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.567036:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e200/0xf8c13e2d0e95a67a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.567046:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e200/0xf8c13e2d0e95a67a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.567053:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213e200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788865030.567070:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e200/0xf8c13e2d0e95a67a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.567081:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e200/0xf8c13e2d0e95a67a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.567109:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fdc834b8400) 00010000:00010000:1.0:1788865030.567113:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788865030.567119:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e200/0xf8c13e2d0e95a67a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.567126:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e200/0xf8c13e2d0e95a67a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788865030.687602:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865030.687910:0:15714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528866432 00000100:00100000:2.0:1788865030.688278:0:15714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528866432 00000100:00100000:2.0:1788865030.688356:0:15714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:2.0:1788865030.688367:0:15714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14989055-e60f-465d-a477-346c1f551105+9:14442:x1875760528866432:12345-192.168.203.13@tcp:101:lctl.0 00010000:00010000:2.0:1788865030.688398:0:15714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788865030.688429:0:15714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a681 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975ff94 expref: -99 pid: 15714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.688504:0:15714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e95a688 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.688521:0:15714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e95a688 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.688555:0:15714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e95a688 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788865030.688745:0:15714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788865030.688750:0:15714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788865030.694142:0:15714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e95a688 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.694210:0:15714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a681 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff94 expref: 11 pid: 15714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.694251:0:15714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384e00/0xf8c13e2d0e95a688 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff94 expref: 10 pid: 15714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.694262:0:15714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc9124ee00) 00010000:00010000:2.0:1788865030.694265:0:15714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788865030.694270:0:15714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384e00, rc 0) 00000100:00100000:2.0:1788865030.694380:0:15714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14989055-e60f-465d-a477-346c1f551105+10:14442:x1875760528866432:12345-192.168.203.13@tcp:101:lctl.0 Request processed in 6012us (6789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865030.694390:0:15714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:2.0:1788865030.740966:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865030.741112:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528866560 00000100:00100000:1.0:1788865030.741126:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528866560 00000100:00100000:1.0:1788865030.741198:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:1.0:1788865030.741234:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae8753b1-5eef-4af3-91d0-fbf927415401+5:14443:x1875760528866560:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788865030.741261:0:14300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788865030.741288:0:14300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75c00/0xf8c13e2d0e95a68f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975ff9b expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.741364:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e95a696 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.741383:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e95a696 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.741396:0:14300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e95a696 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788865030.741437:0:14300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788865030.741441:0:14300:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788865030.741467:0:14300:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e95a696 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.741493:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75c00/0xf8c13e2d0e95a68f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff9b expref: 7 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.741515:0:14300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74600/0xf8c13e2d0e95a696 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ff9b expref: 6 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.741524:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc9124ee00) 00010000:00010000:1.0:1788865030.741528:0:14300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788865030.741532:0:14300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc74600, rc 0) 00000100:00100000:1.0:1788865030.741607:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae8753b1-5eef-4af3-91d0-fbf927415401+6:14443:x1875760528866560:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 375us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865030.741624:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:3.0:1788865030.752516:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865030.752771:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528866688 00000100:00100000:1.0:1788865030.752784:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528866688 00000100:00100000:1.0:1788865030.752861:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:1.0:1788865030.752873:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae8753b1-5eef-4af3-91d0-fbf927415401+6:14443:x1875760528866688:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788865030.752897:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788865030.752924:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75c00/0xf8c13e2d0e95a69d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975ffa2 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.753083:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e95a6a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.753102:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e95a6a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.753117:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e95a6a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.753134:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e95a6ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.753142:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e95a6ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.753150:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e95a6ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.755835:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a6b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.755860:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.755873:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788865030.755944:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788865030.755949:0:14301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788865030.756108:0:14301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.756125:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e95a6a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.756133:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e95a6a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.756140:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e95a6a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.756146:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788865030.756151:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e95a6a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.756160:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e95a6a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.756172:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc9124ee00) 00010000:00010000:2.0:1788865030.756176:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788865030.756181:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e95a6a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.756188:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74c00/0xf8c13e2d0e95a6a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.756205:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e95a6ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.756223:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e95a6ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.756230:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e95a6ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.756235:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788865030.756239:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e95a6ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.756246:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e95a6ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.756255:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fdca4f57200) 00010000:00010000:2.0:1788865030.756257:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788865030.756261:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e95a6ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.756266:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75800/0xf8c13e2d0e95a6ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.756305:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75c00/0xf8c13e2d0e95a69d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffa2 expref: 8 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.756319:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a6b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffa2 expref: 7 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.756326:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:2.0:1788865030.756329:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788865030.756337:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384a00, rc 0) 00000100:00100000:2.0:1788865030.756600:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae8753b1-5eef-4af3-91d0-fbf927415401+7:14443:x1875760528866688:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 3727us (4095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865030.756609:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:0.0:1788865030.764760:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788865030.765676:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528866944 00000100:00100000:3.0:1788865030.765688:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528866944 00000100:00100000:3.0:1788865030.765790:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:3.0:1788865030.765802:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae8753b1-5eef-4af3-91d0-fbf927415401+7:14443:x1875760528866944:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788865030.765822:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788865030.765845:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a6b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975ffa9 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788865030.765945:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788865030.766202:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a6b9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffa9 expref: 9 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.766217:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc9124ee00) 00010000:00010000:3.0:1788865030.766220:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788865030.766224:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a6b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffa9 expref: 9 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.766254:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213fc00, rc 0) 00000100:00100000:3.0:1788865030.766371:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae8753b1-5eef-4af3-91d0-fbf927415401+8:14443:x1875760528866944:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 571us (1618us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788865030.766379:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:0.0:1788865030.774118:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865030.774557:0:15714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528867200 00000100:00100000:2.0:1788865030.774567:0:15714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528867200 00000100:00100000:2.0:1788865030.774670:0:15714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:2.0:1788865030.774682:0:15714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae8753b1-5eef-4af3-91d0-fbf927415401+8:14443:x1875760528867200:12345-192.168.203.13@tcp:36:lfs.0 00010000:00010000:2.0:1788865030.774751:0:15714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788865030.774779:0:15714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a6b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffa2 expref: 8 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.774797:0:15714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:2.0:1788865030.774808:0:15714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788865030.774830:0:15714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a6c7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.774842:0:15714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a6c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.774852:0:15714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a6c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788865030.775086:0:15714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000910a45dd reply state 0000000031e8d784 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a6c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788865030.775095:0:15714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788865030.775103:0:15714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788865030.775197:0:15714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae8753b1-5eef-4af3-91d0-fbf927415401+9:14443:x1875760528867200:12345-192.168.203.13@tcp:36:lfs.0 Request processed in 517us (1163us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788865030.775227:0:15714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:0.0:1788865030.777889:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00010000:00010000:2.0:1788865030.777997:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a6c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.778009:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a6c7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.778016:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a6c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.778021:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788865030.778026:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a6c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.778033:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a6c7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.778065:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fdc9124ea00) 00010000:00010000:2.0:1788865030.778068:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788865030.778072:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a6c7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.778078:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a6c7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788865030.778742:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528867456 00000100:00100000:1.0:1788865030.778753:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528867456 00000100:00100000:1.0:1788865030.778941:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:1.0:1788865030.778972:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ae8753b1-5eef-4af3-91d0-fbf927415401+8:14443:x1875760528867456:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1788865030.779229:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ae8753b1-5eef-4af3-91d0-fbf927415401+9:14443:x1875760528867456:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 257us (1337us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788865030.779237:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:1.0:1788865030.787019:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788865030.787126:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528867712 00000100:00100000:3.0:1788865030.787137:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528867712 00000100:00100000:3.0:1788865030.787259:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:3.0:1788865030.787271:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae8753b1-5eef-4af3-91d0-fbf927415401+9:14443:x1875760528867712:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788865030.787295:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788865030.787314:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a6ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975ffb0 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.787404:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a6d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.787419:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a6d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.787430:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a6d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.787446:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a6dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.787453:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a6dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.787459:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a6dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788865030.787585:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788865030.787672:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a6d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.787681:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a6d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.787687:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a6d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.787693:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213e400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788865030.787697:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a6d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.787738:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a6d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.787752:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc9124ee00) 00010000:00010000:3.0:1788865030.787755:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788865030.787761:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a6d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.787778:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a6d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.787791:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a6dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.787797:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a6dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.787815:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a6dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.787821:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213f800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788865030.787824:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a6dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.787831:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a6dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.787839:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fdc834b8900) 00010000:00010000:3.0:1788865030.787842:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788865030.787845:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a6dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.787851:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a6dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.787890:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a6ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffb0 expref: 11 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.787901:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc9124ee00) 00010000:00010000:3.0:1788865030.787903:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788865030.787907:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a6ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffb0 expref: 11 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865030.787928:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdb8213fc00, rc 0) 00000100:00100000:3.0:1788865030.788855:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae8753b1-5eef-4af3-91d0-fbf927415401+10:14443:x1875760528867712:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1582us (1842us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788865030.788876:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:2.0:1788865030.797204:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865030.797358:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528867840 00000100:00100000:0.0:1788865030.797367:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528867840 00000100:00100000:0.0:1788865030.797434:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:0.0:1788865030.797444:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae8753b1-5eef-4af3-91d0-fbf927415401+10:14443:x1875760528867840:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788865030.797465:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788865030.797487:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7200/0xf8c13e2d0e95a6ea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975ffb7 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.797575:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6000/0xf8c13e2d0e95a6f1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.797588:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6000/0xf8c13e2d0e95a6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.797598:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6000/0xf8c13e2d0e95a6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788865030.797622:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788865030.797626:0:14301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788865030.797644:0:14301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6000/0xf8c13e2d0e95a6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.797669:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7200/0xf8c13e2d0e95a6ea lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffb7 expref: 12 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.797686:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6000/0xf8c13e2d0e95a6f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffb7 expref: 11 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865030.797695:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fdc8399a000) 00010000:00010000:0.0:1788865030.797698:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788865030.797769:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcbd0c6000, rc 0) 00000100:00100000:0.0:1788865030.797821:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae8753b1-5eef-4af3-91d0-fbf927415401+11:14443:x1875760528867840:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 378us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865030.797828:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:0.0:1788865030.807020:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865030.807137:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528867968 00000100:00100000:2.0:1788865030.807149:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528867968 00000100:00100000:2.0:1788865030.807206:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:2.0:1788865030.807218:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ae8753b1-5eef-4af3-91d0-fbf927415401+11:14443:x1875760528867968:12345-192.168.203.13@tcp:37:lfs.0 00000100:00100000:2.0:1788865030.817881:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ae8753b1-5eef-4af3-91d0-fbf927415401+11:14443:x1875760528867968:12345-192.168.203.13@tcp:37:lfs.0 Request processed in 10654us (10859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865030.817895:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:0.0:1788865030.821870:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865030.822199:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528868224 00000100:00100000:1.0:1788865030.822207:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528868224 00000100:00100000:1.0:1788865030.822269:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:1.0:1788865030.822281:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ae8753b1-5eef-4af3-91d0-fbf927415401+11:14443:x1875760528868224:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1788865030.822663:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ae8753b1-5eef-4af3-91d0-fbf927415401+12:14443:x1875760528868224:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 383us (801us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788865030.822672:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000040:00080000:2.0:1788865030.853414:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788865030.890566:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865030.890646:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528868352 00000100:00100000:1.0:1788865030.890671:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528868352 00000100:00100000:1.0:1788865030.890763:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:1.0:1788865030.890774:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14989055-e60f-465d-a477-346c1f551105+10:14449:x1875760528868352:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788865030.890794:0:14300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788865030.890812:0:14300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e95a6f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975ffbe expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.890883:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e95a6ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.890897:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e95a6ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.890910:0:14300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e95a6ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.891540:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95a706 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.891550:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95a706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.891558:0:14300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95a706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.891650:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74400/0xf8c13e2d0e95a70d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.891658:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74400/0xf8c13e2d0e95a70d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.891666:0:14300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74400/0xf8c13e2d0e95a70d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788865030.891691:0:14300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788865030.891694:0:14300:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788865030.891757:0:14300:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74400/0xf8c13e2d0e95a70d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.891769:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e95a6ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.891776:0:14300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e95a6ff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.891783:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e95a6ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.891800:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788865030.891805:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e95a6ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.891813:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e95a6ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.891825:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc9124ee00) 00010000:00010000:1.0:1788865030.891828:0:14300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788865030.891833:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e95a6ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.891839:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc75e00/0xf8c13e2d0e95a6ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.891852:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95a706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.891858:0:14300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95a706 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.891863:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95a706 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.891868:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788865030.891870:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95a706 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.891876:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95a706 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.891894:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fdca4f57b00) 00010000:00010000:1.0:1788865030.891897:0:14300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788865030.891900:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95a706 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.891906:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95a706 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.892412:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e95a6f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffbe expref: 12 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.892429:0:14300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74400/0xf8c13e2d0e95a70d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffbe expref: 11 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.892437:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fdc8399a000) 00010000:00010000:1.0:1788865030.892439:0:14300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788865030.892442:0:14300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc74400, rc 0) 00000100:00100000:1.0:1788865030.892563:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14989055-e60f-465d-a477-346c1f551105+11:14449:x1875760528868352:12345-192.168.203.13@tcp:101:bash.0 Request processed in 1790us (2005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865030.892571:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:0.0:1788865030.897878:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865030.898163:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528868608 00000100:00100000:2.0:1788865030.898173:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528868608 00000100:00100000:2.0:1788865030.898231:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:2.0:1788865030.898242:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14989055-e60f-465d-a477-346c1f551105+11:14449:x1875760528868608:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1788865030.898261:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788865030.898290:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a714 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975ffc5 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.898403:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a71b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.898418:0:14301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6000/0xf8c13e2d0e95a6f1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffb7 expref: 11 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.898428:0:14301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a71b lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.898462:0:14301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6000/0xf8c13e2d0e95a6f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffb7 expref: 11 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.898476:0:14301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6000/0xf8c13e2d0e95a6f1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffb7 expref: 11 pid: 14301 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788865030.898490:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0638000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14301:1875760546681856:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788865030.898607:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc873c1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788865030.902830:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865030.902909:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528868736 00000100:00100000:1.0:1788865030.902919:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528868736 00010000:00010000:1.0:1788865030.902970:0:14286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6000/0xf8c13e2d0e95a6f1 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffb7 expref: 12 pid: 14301 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788865030.903008:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:1.0:1788865030.903024:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc9f45c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae8753b1-5eef-4af3-91d0-fbf927415401+12:2359:x1875760528868736:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788865030.903072:0:14286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788865030.903080:0:14286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6000/0xf8c13e2d0e95a6f1 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffb7 expref: 12 pid: 14301 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.903093:0:14286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6000/0xf8c13e2d0e95a6f1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffb7 expref: 12 pid: 14301 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.903114:0:14286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fdc8399a000) 00010000:00010000:1.0:1788865030.903119:0:14286:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a71b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.903129:0:14286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a71b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.903137:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a71b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.903158:0:14286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788865030.903221:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae8753b1-5eef-4af3-91d0-fbf927415401+12:2359:x1875760528868736:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 205us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865030.903229:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00010000:00010000:2.0:1788865030.903931:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6000/0xf8c13e2d0e95a6f1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffb7 expref: 11 pid: 14301 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788865030.903950:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0638000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14301:1875760546681856:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788865030.904126:0:14301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a71b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.904137:0:14301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a71b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.904143:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a71b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.904168:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a722 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.904178:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a722 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.904186:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a722 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.904932:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384400/0xf8c13e2d0e95a729 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.904945:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384400/0xf8c13e2d0e95a729 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.904953:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384400/0xf8c13e2d0e95a729 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788865030.904986:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788865030.905014:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a71b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.905021:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a71b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.905028:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a71b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.905033:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788865030.905037:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a71b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.905045:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a71b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.905072:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fdc8399a000) 00010000:00010000:2.0:1788865030.905075:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788865030.905079:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a71b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.905085:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a71b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788865030.905097:0:14301:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002206ef35 reply state 00000000c90043e8 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a722 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788865030.905106:0:14301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788865030.905139:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a714 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffc5 expref: 14 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.905171:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384400/0xf8c13e2d0e95a729 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffc5 expref: 13 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.905178:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:2.0:1788865030.905181:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788865030.905183:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384400, rc 0) 00000100:00100000:2.0:1788865030.905245:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc9f45f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14989055-e60f-465d-a477-346c1f551105+14:14449:x1875760528868608:12345-192.168.203.13@tcp:101:bash.0 Request processed in 7006us (7375us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788865030.905253:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00010000:00010000:1.0:1788865030.907431:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a722 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.907447:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a722 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.907454:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a722 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.907476:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788865030.907480:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a722 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.907487:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a722 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.907502:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fdc9124ea00) 00010000:00010000:1.0:1788865030.907505:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788865030.907509:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a722 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865030.907514:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a722 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865030.918283:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865030.918380:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528868864 00000100:00100000:2.0:1788865030.918390:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528868864 00000100:00100000:2.0:1788865030.918443:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:2.0:1788865030.918452:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14989055-e60f-465d-a477-346c1f551105+13:14449:x1875760528868864:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1788865030.918475:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788865030.918496:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a737 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975ffcc expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.918572:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a73e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.918586:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a73e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.918597:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a73e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788865030.918636:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788865030.918654:0:14303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788865030.918675:0:14303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a73e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.918687:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a73e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.918746:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a737 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffcc expref: 15 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.918763:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a73e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffcc expref: 14 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865030.918772:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:2.0:1788865030.918775:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788865030.918779:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384a00, rc 0) 00000100:00100000:2.0:1788865030.918830:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14989055-e60f-465d-a477-346c1f551105+14:14449:x1875760528868864:12345-192.168.203.13@tcp:101:bash.0 Request processed in 379us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865030.918837:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:0.0:1788865030.923391:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865030.923485:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528869120 00000100:00100000:1.0:1788865030.923494:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528869120 00000100:00100000:1.0:1788865030.923577:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:1.0:1788865030.923588:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14989055-e60f-465d-a477-346c1f551105+14:14449:x1875760528869120:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:1.0:1788865030.924102:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14989055-e60f-465d-a477-346c1f551105+15:14449:x1875760528869120:12345-192.168.203.13@tcp:35:bash.0 Request processed in 514us (718us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788865030.924111:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:0.0:1788865031.064078:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865031.064176:0:15714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528869376 00000100:00100000:2.0:1788865031.064186:0:15714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528869376 00000100:00100000:2.0:1788865031.064245:0:15714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:2.0:1788865031.064257:0:15714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14989055-e60f-465d-a477-346c1f551105+15:14459:x1875760528869376:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788865031.064280:0:15714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788865031.064300:0:15714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a745 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975ffd3 expref: -99 pid: 15714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788865031.064386:0:15714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788865031.064501:0:15714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a745 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffd3 expref: 17 pid: 15714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.064531:0:15714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fdc9124ee00) 00010000:00010000:2.0:1788865031.064535:0:15714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788865031.064553:0:15714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a745 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffd3 expref: 17 pid: 15714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.064568:0:15714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385000, rc 0) 00000100:00100000:2.0:1788865031.064634:0:15714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14989055-e60f-465d-a477-346c1f551105+16:14459:x1875760528869376:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 379us (565us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788865031.064642:0:15714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:3.0:1788865031.073435:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865031.073596:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528869632 00000100:00100000:2.0:1788865031.073606:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528869632 00000100:00100000:2.0:1788865031.073724:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:2.0:1788865031.073736:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14989055-e60f-465d-a477-346c1f551105+16:14459:x1875760528869632:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788865031.073956:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14989055-e60f-465d-a477-346c1f551105+17:14459:x1875760528869632:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 221us (527us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788865031.073964:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1788865031.175289:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865031.176157:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528869888 00000100:00100000:2.0:1788865031.176168:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528869888 00000100:00100000:2.0:1788865031.176238:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:2.0:1788865031.176247:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14989055-e60f-465d-a477-346c1f551105+17:14462:x1875760528869888:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788865031.176270:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788865031.176289:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a753 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975ffda expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.176934:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a75a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.176971:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a75a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.176984:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a75a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788865031.176997:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788865031.177675:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a753 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffda expref: 20 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.177696:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a75a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffda expref: 19 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.177747:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:2.0:1788865031.177750:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788865031.177753:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385400, rc 0) 00000100:00100000:2.0:1788865031.177824:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14989055-e60f-465d-a477-346c1f551105+19:14462:x1875760528869888:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1576us (2544us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788865031.177832:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:0.0:1788865031.181629:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865031.181675:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865031.181786:0:15714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528870016 00000100:00100000:2.0:1788865031.181796:0:15714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528870016 00000100:00100000:2.0:1788865031.181845:0:15714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:2.0:1788865031.181855:0:15714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14989055-e60f-465d-a477-346c1f551105+19:14462:x1875760528870016:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:2.0:1788865031.181930:0:15714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a768 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.181947:0:15714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a768 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.181972:0:15714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a768 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.181997:0:15714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a768 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.182015:0:15714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a768 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.182023:0:15714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a768 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.182028:0:15714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788865031.182032:0:15714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a768 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.182039:0:15714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a768 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.182051:0:15714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:2.0:1788865031.182061:0:15714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788865031.182067:0:15714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a768 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.182072:0:15714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a768 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788865031.182151:0:15714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14989055-e60f-465d-a477-346c1f551105+19:14462:x1875760528870016:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 287us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865031.182159:0:15714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:1.0:1788865031.192456:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528870144 00000100:00100000:1.0:1788865031.192471:0:14287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528870144 00000100:00100000:1.0:1788865031.192551:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:1.0:1788865031.193463:0:14287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc85b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14989055-e60f-465d-a477-346c1f551105+19:2358:x1875760528870144:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788865031.193499:0:14287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788865031.193526:0:14287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a75a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffda expref: 19 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865031.193545:0:14287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:1.0:1788865031.193550:0:14287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788865031.193798:0:14287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc85b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14989055-e60f-465d-a477-346c1f551105+18:2358:x1875760528870144:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 346us (12120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865031.193806:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:2.0:1788865031.200814:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865031.209229:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528870400 00000100:00100000:1.0:1788865031.209243:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528870400 00000100:00100000:0.0:1788865031.209490:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:0.0:1788865031.209501:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0638000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14989055-e60f-465d-a477-346c1f551105+18:14462:x1875760528870400:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1788865031.209767:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0638000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14989055-e60f-465d-a477-346c1f551105+19:14462:x1875760528870400:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 267us (8963us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788865031.209776:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1788865031.495117:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788865031.495159:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc86f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546681984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788865031.495232:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788865031.495320:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546681984 00000100:00100000:2.0:1788865031.495328:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546681984 00000100:00100000:2.0:1788865031.495384:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788865031.495395:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc063a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546681984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788865031.495434:0:14987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788865031.495482:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc063a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875760546681984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865031.495488:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788865031.495513:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788865031.496447:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875760546682496:0@lo:400:kworker.0 00000100:00100000:0.0:1788865031.496493:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788865031.496523:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788865031.496529:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875760546682368:0@lo:400:kworker.0 00000100:00100000:0.0:1788865031.496628:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788865031.496657:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546682496 00000100:00100000:0.0:1788865031.496663:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546682496 00000100:00080000:0.0:1788865031.496681:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788865031.496735:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546682368 00000100:00100000:0.0:1788865031.496750:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546682368 00000100:00100000:1.0:1788865031.496926:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3300:1875760546682112:0@lo:400:kworker.0 00000100:00100000:1.0:1788865031.496972:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788865031.496999:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546682624:0@lo:400:kworker.0 00000100:00100000:1.0:1788865031.497020:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788865031.497033:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788865031.497038:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546682240:0@lo:400:kworker.0 00000100:00100000:1.0:1788865031.497072:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788865031.497100:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546682240 00000100:00100000:1.0:1788865031.497104:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546682240 00000100:00100000:1.0:1788865031.497133:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788865031.497155:0:14985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546682240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788865031.497197:0:14985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875760546682240:12345-0@lo:400:kworker.0 Request processed in 58us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865031.497204:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788865031.497240:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875760546682240:0@lo:400:kworker.0 00000100:00100000:1.0:1788865031.497272:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546682112 00000100:00100000:1.0:1788865031.497276:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546682112 00000100:00100000:1.0:1788865031.497314:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788865031.497321:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:3300:x1875760546682112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788865031.497356:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c43d6a-bb58-4fb8-a6ee-705419d652e1+19:3300:x1875760546682112:12345-0@lo:400:kworker.0 Request processed in 35us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865031.497362:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788865031.497392:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c43d6a-bb58-4fb8-a6ee-705419d652e1:3300:1875760546682112:0@lo:400:kworker.0 00000100:00100000:1.0:1788865031.497428:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546682624 00000100:00100000:1.0:1788865031.497432:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546682624 00000100:00080000:1.0:1788865031.497448:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788865031.497465:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788865031.497472:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875760546682496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788865031.497507:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875760546682496:12345-0@lo:400:kworker.0 Request processed in 36us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865031.497513:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788865031.498657:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788865031.498674:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875760546682368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788865031.498739:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875760546682368:12345-0@lo:400:kworker.0 Request processed in 72us (2111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865031.498746:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788865031.498768:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788865031.498871:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc86f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875760546681984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788865031.499809:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546682624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788865031.499879:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875760546682624:12345-0@lo:400:kworker.0 Request processed in 78us (2857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865031.499921:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875760546682496:0@lo:400:kworker.0 00000100:00100000:1.0:1788865031.499966:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875760546682368:0@lo:400:kworker.0 00000100:00100000:1.0:1788865031.499991:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875760546682624:0@lo:400:kworker.0 00000100:00100000:0.0:1788865031.502935:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788865031.556899:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788865031.557610:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865031.557744:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528870656 00000100:00100000:1.0:1788865031.557754:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528870656 00000100:00100000:1.0:1788865031.557810:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:1.0:1788865031.557821:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc063aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14989055-e60f-465d-a477-346c1f551105+19:14493:x1875760528870656:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:1.0:1788865031.557857:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788865031.557888:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e95a76f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975ffe1 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865031.557997:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95a776 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865031.558012:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95a776 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865031.558036:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95a776 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788865031.558048:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788865031.558204:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74800/0xf8c13e2d0e95a76f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffe1 expref: 22 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865031.558222:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95a776 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffe1 expref: 21 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865031.558230:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:1.0:1788865031.558233:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788865031.558235:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc74200, rc 0) 00000100:00100000:1.0:1788865031.558292:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc063aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14989055-e60f-465d-a477-346c1f551105+21:14493:x1875760528870656:12345-192.168.203.13@tcp:101:cat.0 Request processed in 474us (691us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788865031.558300:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:1.0:1788865031.570578:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865031.570620:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865031.570652:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865031.570655:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528870784 00000100:00100000:0.0:1788865031.570667:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528870784 00000100:00100000:1.0:1788865031.570689:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865031.570739:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528871040 00000100:00100000:3.0:1788865031.570749:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528871296 00000100:00100000:3.0:1788865031.570755:0:14983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528871296 00000100:00100000:1.0:1788865031.570757:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528871040 00000100:00100000:3.0:1788865031.570800:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528870912 00000100:00100000:3.0:1788865031.570805:0:14983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528870912 00000100:00100000:2.0:1788865031.570822:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:2.0:1788865031.570842:0:14986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae8753b1-5eef-4af3-91d0-fbf927415401+5:2358:x1875760528871296:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788865031.570866:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:0.0:1788865031.570879:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+13:2358:x1875760528870784:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788865031.570915:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e4b30ef-707f-4a68-abf9-d500481ae7c8+13:2358:x1875760528870784:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 40us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865031.570922:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:2.0:1788865031.570927:0:14986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae8753b1-5eef-4af3-91d0-fbf927415401+5:2358:x1875760528871296:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 77us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865031.570937:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:2.0:1788865031.570982:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865031.571007:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528871168 00000100:00100000:2.0:1788865031.571011:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528871168 00000100:00100000:2.0:1788865031.571043:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:2.0:1788865031.571062:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc063b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae8753b1-5eef-4af3-91d0-fbf927415401+11:2358:x1875760528871168:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788865031.571096:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc063b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae8753b1-5eef-4af3-91d0-fbf927415401+11:2358:x1875760528871168:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 46us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865031.571111:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:2.0:1788865031.571151:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865031.571165:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528871424 00000100:00100000:2.0:1788865031.571169:0:14986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528871424 00000100:00100000:1.0:1788865031.572216:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:1.0:1788865031.572227:0:14985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14989055-e60f-465d-a477-346c1f551105+5:2358:x1875760528871040:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788865031.572277:0:14985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14989055-e60f-465d-a477-346c1f551105+5:2358:x1875760528871040:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 53us (1656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865031.572283:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:1.0:1788865031.574385:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865031.574446:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528871680 00000100:00100000:1.0:1788865031.574456:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528871680 00000100:00100000:1.0:1788865031.574504:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:1.0:1788865031.574514:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14989055-e60f-465d-a477-346c1f551105+21:14493:x1875760528871680:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:1.0:1788865031.574850:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14989055-e60f-465d-a477-346c1f551105+22:14493:x1875760528871680:12345-192.168.203.13@tcp:35:cat.0 Request processed in 336us (472us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788865031.574857:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:1.0:1788865031.575424:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865031.575463:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528871808 00000100:00100000:1.0:1788865031.575469:0:14288:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528871808 00000100:00100000:1.0:1788865031.575513:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:1.0:1788865031.575521:0:14288:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14989055-e60f-465d-a477-346c1f551105+22:2359:x1875760528871808:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788865031.575534:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788865031.575944:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcafc74200/0xf8c13e2d0e95a776 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffe1 expref: 22 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865031.575962:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:1.0:1788865031.575967:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788865031.576004:0:14288:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14989055-e60f-465d-a477-346c1f551105+21:2359:x1875760528871808:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 483us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865031.576023:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:3.0:1788865031.580371:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1788865031.580384:0:14983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14989055-e60f-465d-a477-346c1f551105+5:2358:x1875760528870912:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788865031.580457:0:14983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14989055-e60f-465d-a477-346c1f551105+5:2358:x1875760528870912:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 76us (9767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865031.580465:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:2.0:1788865031.590876:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:2.0:1788865031.590892:0:14986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc063b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae8753b1-5eef-4af3-91d0-fbf927415401+5:2358:x1875760528871424:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788865031.592121:0:14986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc063b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae8753b1-5eef-4af3-91d0-fbf927415401+5:2358:x1875760528871424:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 1227us (20962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865031.592133:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00080000:0.0:1788865031.597281:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788865031.597296:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788865031.642931:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865031.643091:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528872064 00000100:00100000:2.0:1788865031.643101:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528872064 00000100:00100000:2.0:1788865031.643165:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:2.0:1788865031.643175:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14989055-e60f-465d-a477-346c1f551105+21:14499:x1875760528872064:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:2.0:1788865031.643199:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788865031.643221:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a784 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975ffe8 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.643322:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a78b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.643337:0:14303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384400/0xf8c13e2d0e95a729 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffc5 expref: 22 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.643345:0:14303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a73e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffcc expref: 22 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.643370:0:14303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a78b lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.643403:0:14303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a73e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffcc expref: 22 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.643417:0:14303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a73e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffcc expref: 22 pid: 14303 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788865031.643431:0:14303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc063bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14303:1875760546682752:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788865031.643527:0:14303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384400/0xf8c13e2d0e95a729 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffc5 expref: 22 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.643537:0:14303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384400/0xf8c13e2d0e95a729 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffc5 expref: 22 pid: 14301 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788865031.643546:0:14303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0638e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14303:1875760546682880:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788865031.643582:0:14303:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc873c1780 going to sleep for 11 seconds 00000100:00100000:1.0:1788865031.647337:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865031.647381:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865031.647470:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528872192 00000100:00100000:0.0:1788865031.647480:0:14288:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528872192 00010000:00010000:0.0:1788865031.647519:0:14288:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a73e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffcc expref: 23 pid: 14303 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788865031.647554:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528872320 00000100:00100000:0.0:1788865031.647577:0:14288:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528872320 00010000:00010000:0.0:1788865031.647592:0:14288:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384400/0xf8c13e2d0e95a729 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffc5 expref: 24 pid: 14301 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788865031.647609:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1788865031.647618:0:14288:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc14cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14989055-e60f-465d-a477-346c1f551105+24:2359:x1875760528872192:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788865031.647633:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788865031.647639:0:14288:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a73e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffcc expref: 24 pid: 14303 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.647651:0:14288:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a73e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffcc expref: 24 pid: 14303 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.647671:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:0.0:1788865031.647676:0:14288:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a78b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.647685:0:14288:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a78b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.647691:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788865031.647772:0:14288:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc14cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14989055-e60f-465d-a477-346c1f551105+24:2359:x1875760528872192:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 154us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865031.647779:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1788865031.647825:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:0.0:1788865031.647832:0:14288:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14989055-e60f-465d-a477-346c1f551105+23:2359:x1875760528872320:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788865031.647840:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788865031.647845:0:14288:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384400/0xf8c13e2d0e95a729 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffc5 expref: 23 pid: 14301 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.647861:0:14288:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384400/0xf8c13e2d0e95a729 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffc5 expref: 23 pid: 14301 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.647872:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:0.0:1788865031.647876:0:14288:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a78b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.647883:0:14288:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a78b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.647890:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a78b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.647907:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788865031.647939:0:14288:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14989055-e60f-465d-a477-346c1f551105+23:2359:x1875760528872320:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 108us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865031.647945:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00010000:00010000:2.0:1788865031.648753:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384a00/0xf8c13e2d0e95a73e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffcc expref: 22 pid: 14303 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788865031.648771:0:14303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc063bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14303:1875760546682752:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788865031.648795:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384400/0xf8c13e2d0e95a729 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffc5 expref: 21 pid: 14301 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788865031.648822:0:14303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0638e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14303:1875760546682880:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788865031.648860:0:14303:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a78b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.648870:0:14303:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a78b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.648877:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a78b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788865031.648894:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788865031.649071:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a784 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffe8 expref: 22 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.649087:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385000/0xf8c13e2d0e95a78b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffe8 expref: 21 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.649096:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:2.0:1788865031.649099:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788865031.649101:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5385000, rc 0) 00000100:00100000:2.0:1788865031.649189:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14989055-e60f-465d-a477-346c1f551105+21:14499:x1875760528872064:12345-192.168.203.13@tcp:101:dd.0 Request processed in 6015us (6276us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788865031.649197:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:1.0:1788865031.653617:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865031.653752:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528872576 00000100:00100000:2.0:1788865031.653762:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528872576 00000100:00100000:2.0:1788865031.653954:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:2.0:1788865031.653966:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14989055-e60f-465d-a477-346c1f551105+21:14499:x1875760528872576:12345-192.168.203.13@tcp:36:dd.0 00010000:00010000:2.0:1788865031.654232:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a799 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.654249:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a799 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.654261:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a799 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788865031.654309:0:14301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788865031.654334:0:14301:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e87c0625 reply state 0000000013e462f9 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a799 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788865031.654344:0:14301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788865031.654435:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14989055-e60f-465d-a477-346c1f551105+24:14499:x1875760528872576:12345-192.168.203.13@tcp:36:dd.0 Request processed in 470us (887us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788865031.654443:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00000020:00080000:2.0:1788865031.654448:0:14301:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788865031.657404:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00010000:00010000:1.0:1788865031.657453:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a799 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865031.657465:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a799 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865031.657473:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a799 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865031.657480:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1788865031.657485:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a799 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865031.657493:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a799 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865031.657509:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:1.0:1788865031.657512:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788865031.657517:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a799 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865031.657523:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a799 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788865031.658347:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528872704 00000100:00100000:0.0:1788865031.658359:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528872704 00000100:00100000:0.0:1788865031.658417:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:0.0:1788865031.658427:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14989055-e60f-465d-a477-346c1f551105+23:14499:x1875760528872704:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:0.0:1788865031.658450:0:14300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788865031.658468:0:14300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6a00/0xf8c13e2d0e95a7a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975ffef expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.658522:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6a00/0xf8c13e2d0e95a7a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffef expref: 24 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.658565:0:14300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6a00/0xf8c13e2d0e95a7a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffef expref: 24 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.658587:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:0.0:1788865031.658590:0:14300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788865031.658593:0:14300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcbd0c6a00, rc 0) 00000100:00100000:0.0:1788865031.658652:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14989055-e60f-465d-a477-346c1f551105+24:14499:x1875760528872704:12345-192.168.203.13@tcp:101:dd.0 Request processed in 227us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865031.658660:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:1.0:1788865031.672797:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865031.673222:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528872960 00000100:00100000:0.0:1788865031.673231:0:14288:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528872960 00000100:00100000:0.0:1788865031.673296:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:0.0:1788865031.673307:0:14288:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14989055-e60f-465d-a477-346c1f551105+24:14499:x1875760528872960:12345-192.168.203.13@tcp:103:dd.0 00010000:00010000:0.0:1788865031.673323:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788865031.673346:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6a00/0xf8c13e2d0e95a7a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975ffef expref: 24 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.673364:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:0.0:1788865031.673369:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788865031.673426:0:14288:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14989055-e60f-465d-a477-346c1f551105+23:14499:x1875760528872960:12345-192.168.203.13@tcp:103:dd.0 Request processed in 121us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865031.673434:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:0.0:1788865031.675583:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865031.675670:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528873088 00000100:00100000:2.0:1788865031.675679:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528873088 00000100:00100000:2.0:1788865031.675764:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:2.0:1788865031.675774:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc85b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14989055-e60f-465d-a477-346c1f551105+23:14499:x1875760528873088:12345-192.168.203.13@tcp:58:dd.0 00010000:00010000:2.0:1788865031.675874:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a7a7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.675890:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a7a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.675902:0:14300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a7a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788865031.676770:0:14300:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788865031.677270:0:14300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788865031.677343:0:14300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788865031.677499:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc85b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14989055-e60f-465d-a477-346c1f551105+23:14499:x1875760528873088:12345-192.168.203.13@tcp:58:dd.0 Request processed in 1722us (1919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865031.677510:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:3.0:1788865031.680815:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865031.680912:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528873216 00000100:00100000:2.0:1788865031.680923:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528873216 00000100:00100000:2.0:1788865031.680981:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:2.0:1788865031.680991:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14989055-e60f-465d-a477-346c1f551105+23:14499:x1875760528873216:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:2.0:1788865031.681010:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788865031.681030:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384400/0xf8c13e2d0e95a7ae lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fff6 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.681099:0:14303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a7a7 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.681110:0:14303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384400/0xf8c13e2d0e95a7ae lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fff6 expref: 24 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.681129:0:14303:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a7a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.681142:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384400/0xf8c13e2d0e95a7ae lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fff6 expref: 24 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.681156:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:2.0:1788865031.681172:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788865031.681177:0:14303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384400/0xf8c13e2d0e95a7ae lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fff6 expref: 24 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.681185:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384400, rc 0) 00000100:00100000:2.0:1788865031.681239:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14989055-e60f-465d-a477-346c1f551105+24:14499:x1875760528873216:12345-192.168.203.13@tcp:101:dd.0 Request processed in 250us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865031.681247:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000040:00080000:2.0:1788865031.878081:0:14333:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788865031.878092:0:14333:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788865031.878150:0:14333:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788865031.878159:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788865031.878281:0:14333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0638e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14333:1875760546683008:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788865031.878386:0:14333:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc873c1540 going to sleep for 11 seconds 00000100:00100000:2.0:1788865031.887178:0:14333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0638e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14333:1875760546683008:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788865031.887848:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865031.888263:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528873344 00000100:00100000:1.0:1788865031.888272:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528873344 00000100:00100000:1.0:1788865031.888324:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:1.0:1788865031.888333:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:14989055-e60f-465d-a477-346c1f551105+24:14500:x1875760528873344:12345-192.168.203.13@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788865031.888419:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:14989055-e60f-465d-a477-346c1f551105+24:14500:x1875760528873344:12345-192.168.203.13@tcp:900:lhsmtool_posix.0 Request processed in 86us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865031.888427:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:3.0:1788865031.896765:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865031.899370:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528873472 00000100:00100000:0.0:1788865031.899397:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528873472 00000100:00100000:0.0:1788865031.899455:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:0.0:1788865031.899464:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14989055-e60f-465d-a477-346c1f551105+24:14500:x1875760528873472:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788865031.899510:0:14301:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788865031.899625:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14989055-e60f-465d-a477-346c1f551105+24:14500:x1875760528873472:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 161us (2870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865031.899632:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:2.0:1788865031.908337:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788865031.908865:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528873600 00000100:00100000:3.0:1788865031.908886:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528873600 00000100:00100000:3.0:1788865031.908947:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:3.0:1788865031.908956:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0638e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14989055-e60f-465d-a477-346c1f551105+24:14500:x1875760528873600:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788865031.909027:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e95a7b5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909043:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e95a7b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909066:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e95a7b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909150:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a7bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909159:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a7bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909166:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a7bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909191:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a7c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909199:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909205:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788865031.909242:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788865031.909246:0:14303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788865031.909258:0:14303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909269:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e95a7b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909276:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e95a7b5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909283:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e95a7b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909300:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213ea00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788865031.909304:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e95a7b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909311:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e95a7b5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909323:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fdc8399a900) 00010000:00010000:3.0:1788865031.909327:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788865031.909331:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e95a7b5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909337:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e95a7b5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909350:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a7bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909356:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a7bc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909361:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a7bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909366:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213e400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788865031.909369:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a7bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909375:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a7bc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909395:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9fdc834b8900) 00010000:00010000:3.0:1788865031.909397:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788865031.909400:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a7bc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909406:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a7bc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909421:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909426:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a7c3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909432:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a7c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909437:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213f800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788865031.909440:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a7c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909446:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a7c3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909452:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:3.0:1788865031.909455:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788865031.909457:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a7c3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.909463:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a7c3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865031.909674:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0638e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14989055-e60f-465d-a477-346c1f551105+24:14500:x1875760528873600:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 717us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865031.909683:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:1.0:1788865031.919444:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865031.919529:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528873856 00000100:00100000:0.0:1788865031.919538:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528873856 00000100:00100000:0.0:1788865031.919596:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:0.0:1788865031.919605:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14989055-e60f-465d-a477-346c1f551105+24:14500:x1875760528873856:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788865031.919624:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788865031.919642:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6a00/0xf8c13e2d0e95a7ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba975fffd expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.919756:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7000/0xf8c13e2d0e95a7d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.919769:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7000/0xf8c13e2d0e95a7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.919780:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7000/0xf8c13e2d0e95a7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788865031.919791:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788865031.919869:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7000/0xf8c13e2d0e95a7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.919876:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7000/0xf8c13e2d0e95a7d1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.919894:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7000/0xf8c13e2d0e95a7d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.919900:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcbd0c7000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1788865031.919904:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7000/0xf8c13e2d0e95a7d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.919911:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7000/0xf8c13e2d0e95a7d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.919922:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:0.0:1788865031.919925:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788865031.919930:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7000/0xf8c13e2d0e95a7d1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.919936:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7000/0xf8c13e2d0e95a7d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.919971:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6a00/0xf8c13e2d0e95a7ca lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fffd expref: 26 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.919981:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fdc8399a900) 00010000:00010000:0.0:1788865031.919983:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788865031.919987:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6a00/0xf8c13e2d0e95a7ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fffd expref: 26 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.919996:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcbd0c6a00, rc 0) 00000100:00100000:0.0:1788865031.920069:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14989055-e60f-465d-a477-346c1f551105+25:14500:x1875760528873856:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 463us (633us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1788865031.920087:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:1.0:1788865031.925820:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865031.925967:0:15714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528873984 00000100:00100000:0.0:1788865031.925978:0:15714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528873984 00000100:00100000:0.0:1788865031.926044:0:15714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:0.0:1788865031.926063:0:15714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14989055-e60f-465d-a477-346c1f551105+25:14500:x1875760528873984:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788865031.926101:0:15714:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788865031.926241:0:15714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14989055-e60f-465d-a477-346c1f551105+25:14500:x1875760528873984:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 179us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865031.926249:0:15714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:1.0:1788865031.932905:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865031.932966:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528874240 00000100:00100000:2.0:1788865031.932977:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528874240 00000100:00100000:2.0:1788865031.933065:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:2.0:1788865031.933076:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14989055-e60f-465d-a477-346c1f551105+25:14500:x1875760528874240:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788865031.933096:0:14300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788865031.933117:0:14300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95a7df lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba9760004 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788865031.933810:0:14300:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:2.0:1788865031.933818:0:14300:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1788865031.933875:0:14300:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1788865031.934176:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a7e6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.934192:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.934203:0:14300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.934262:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385e00/0xf8c13e2d0e95a7df lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760004 expref: 28 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.934278:0:14300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a7e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760004 expref: 27 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.934286:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:2.0:1788865031.934289:0:14300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788865031.934292:0:14300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcb5384c00, rc 0) 00000100:00100000:2.0:1788865031.934354:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14989055-e60f-465d-a477-346c1f551105+27:14500:x1875760528874240:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1280us (1458us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788865031.934362:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:1.0:1788865031.944112:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788865031.944314:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528874496 00000100:00100000:3.0:1788865031.944323:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528874496 00000100:00100000:3.0:1788865031.944478:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:3.0:1788865031.944489:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14989055-e60f-465d-a477-346c1f551105+27:14500:x1875760528874496:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788865031.944643:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788865031.944669:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384c00/0xf8c13e2d0e95a7e6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760004 expref: 27 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.944687:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fdc9124e300) 00010000:00010000:3.0:1788865031.944697:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788865031.944762:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a7f4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.944775:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a7f4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.944785:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a7f4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.944838:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a7fb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x63fefa52 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.944846:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a7fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x63fefa52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.944852:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a7fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x63fefa52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.944942:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a7f4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.944949:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a7f4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.944955:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a7f4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.944966:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213f800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788865031.944971:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a7f4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.944979:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a7f4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.944988:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fdc8399a000) 00010000:00010000:3.0:1788865031.944991:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788865031.945001:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a7f4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.945007:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213f800/0xf8c13e2d0e95a7f4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.945016:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a7fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x63fefa52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.945022:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a7fb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x63fefa52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.945034:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a7fb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x63fefa52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.945055:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213e400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788865031.945064:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a7fb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x63fefa52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.945071:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a7fb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x63fefa52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.945080:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x63fefa52 (ffff9fdc834b8900) 00010000:00010000:3.0:1788865031.945082:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788865031.945085:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a7fb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x63fefa52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865031.945091:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213e400/0xf8c13e2d0e95a7fb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x63fefa52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865031.945400:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14989055-e60f-465d-a477-346c1f551105+26:14500:x1875760528874496:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 912us (1297us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788865031.945409:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:3.0:1788865031.949959:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865031.950038:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528874624 00000100:00100000:0.0:1788865031.950057:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528874624 00000100:00100000:0.0:1788865031.950116:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:0.0:1788865031.950134:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14989055-e60f-465d-a477-346c1f551105+26:14500:x1875760528874624:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788865031.950153:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788865031.950175:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6a00/0xf8c13e2d0e95a802 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba976000b expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.950209:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7000/0xf8c13e2d0e95a809 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.950227:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7000/0xf8c13e2d0e95a809 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.950239:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7000/0xf8c13e2d0e95a809 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.950338:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6a00/0xf8c13e2d0e95a802 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba976000b expref: 28 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.950362:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7000/0xf8c13e2d0e95a809 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba976000b expref: 27 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.950370:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fdc83b0df00) 00010000:00010000:0.0:1788865031.950373:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788865031.950376:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcbd0c7000, rc 0) 00000100:00100000:0.0:1788865031.950435:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14989055-e60f-465d-a477-346c1f551105+27:14500:x1875760528874624:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 302us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865031.950441:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:1.0:1788865031.968215:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865031.968378:0:15714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528874880 00000100:00100000:0.0:1788865031.968388:0:15714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528874880 00000100:00100000:0.0:1788865031.968447:0:15714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:0.0:1788865031.968458:0:15714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14989055-e60f-465d-a477-346c1f551105+27:14500:x1875760528874880:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788865031.968551:0:15714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6a00/0xf8c13e2d0e95a810 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.968571:0:15714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6a00/0xf8c13e2d0e95a810 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.968582:0:15714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6a00/0xf8c13e2d0e95a810 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788865031.969008:0:15714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1788865031.969019:0:15714:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 455100314218ns, next at 456100311826ns, rc = 0 00000004:00010000:0.0:1788865031.969112:0:15714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079edef8e reply state 0000000049adeacc transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6a00/0xf8c13e2d0e95a810 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788865031.969208:0:15714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788865031.969305:0:15714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14989055-e60f-465d-a477-346c1f551105+29:14500:x1875760528874880:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 848us (1097us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788865031.969313:0:15714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00010000:00010000:2.0:1788865031.973247:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6a00/0xf8c13e2d0e95a810 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.973264:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6a00/0xf8c13e2d0e95a810 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.973272:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6a00/0xf8c13e2d0e95a810 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.973279:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcbd0c6a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1788865031.973297:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6a00/0xf8c13e2d0e95a810 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.973305:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6a00/0xf8c13e2d0e95a810 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.973322:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fdc83b0df00) 00010000:00010000:2.0:1788865031.973325:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788865031.973330:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6a00/0xf8c13e2d0e95a810 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865031.973336:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6a00/0xf8c13e2d0e95a810 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788865031.976065:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865031.976361:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528875008 00000100:00100000:0.0:1788865031.976371:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528875008 00000100:00100000:0.0:1788865031.976431:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:0.0:1788865031.976442:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14989055-e60f-465d-a477-346c1f551105+28:14500:x1875760528875008:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788865031.976466:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788865031.976487:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a817 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba9760012 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.976545:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a817 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760012 expref: 29 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.976570:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a817 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760012 expref: 29 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865031.976589:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fdc83b0df00) 00010000:00010000:0.0:1788865031.976593:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788865031.976596:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcbd0c7c00, rc 0) 00000100:00100000:0.0:1788865031.976651:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14989055-e60f-465d-a477-346c1f551105+29:14500:x1875760528875008:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 210us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865031.976658:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:1.0:1788865031.983799:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788865031.988698:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528875136 00000100:00100000:3.0:1788865031.988726:0:14983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528875136 00000100:00100000:3.0:1788865031.988801:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1788865031.988812:0:14983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0554380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14989055-e60f-465d-a477-346c1f551105+5:2359:x1875760528875136:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788865031.990292:0:14983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0554380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14989055-e60f-465d-a477-346c1f551105+6:2359:x1875760528875136:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 1478us (6498us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788865031.990301:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:1.0:1788865032.002865:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865032.003619:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528875392 00000100:00100000:2.0:1788865032.003628:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528875392 00000100:00100000:2.0:1788865032.003786:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:2.0:1788865032.003798:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14989055-e60f-465d-a477-346c1f551105+29:14500:x1875760528875392:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788865032.004105:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14989055-e60f-465d-a477-346c1f551105+30:14500:x1875760528875392:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 309us (1249us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1788865032.004113:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00080000:0.0:1788865032.007497:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788865032.008393:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865032.008479:0:15714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528875648 00000100:00100000:0.0:1788865032.008501:0:15714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528875648 00000100:00100000:0.0:1788865032.008572:0:15714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:0.0:1788865032.008581:0:15714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14989055-e60f-465d-a477-346c1f551105+30:14500:x1875760528875648:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788865032.008688:0:15714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14989055-e60f-465d-a477-346c1f551105+30:14500:x1875760528875648:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 107us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865032.008695:0:15714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:3.0:1788865032.012623:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865032.012828:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528875776 00000100:00100000:0.0:1788865032.012838:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528875776 00000100:00100000:0.0:1788865032.012891:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:0.0:1788865032.012901:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86ebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14989055-e60f-465d-a477-346c1f551105+30:14500:x1875760528875776:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788865032.012919:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788865032.012937:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6000/0xf8c13e2d0e95a81e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba9760019 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865032.012997:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a825 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865032.013019:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a825 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865032.013030:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a825 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788865032.013071:0:14301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788865032.013088:0:14301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a825 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865032.013112:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6000/0xf8c13e2d0e95a81e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760019 expref: 32 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865032.013305:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a825 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760019 expref: 31 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865032.013313:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fdc83b0df00) 00010000:00010000:0.0:1788865032.013317:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788865032.013320:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcbd0c6c00, rc 0) 00000100:00100000:0.0:1788865032.013377:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86ebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14989055-e60f-465d-a477-346c1f551105+31:14500:x1875760528875776:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 477us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865032.013385:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:3.0:1788865032.018480:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865032.018575:0:16044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528875904 00000100:00100000:1.0:1788865032.018585:0:16044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528875904 00000100:00100000:1.0:1788865032.018643:0:16044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:1.0:1788865032.018654:0:16044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14989055-e60f-465d-a477-346c1f551105+6:2358:x1875760528875904:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788865032.018670:0:16044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788865032.018689:0:16044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062da7701/0xf8c13e2d0e95a82c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba9760020 expref: -99 pid: 16044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788865032.018742:0:16044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fea07, blocks: 0x1 00010000:00010000:1.0:1788865032.018767:0:16044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1788865032.018771:0:16044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788865032.018793:0:16044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062da7701/0xf8c13e2d0e95a82c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760020 expref: 7 pid: 16044 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.018813:0:16044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062da7701/0xf8c13e2d0e95a82c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760020 expref: 7 pid: 16044 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.018826:0:16044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc74800, rc 0) 00000100:00100000:1.0:1788865032.018887:0:16044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14989055-e60f-465d-a477-346c1f551105+7:2358:x1875760528875904:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 234us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865032.018895:0:16044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:1.0:1788865032.022758:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865032.022887:0:15714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528876160 00000100:00100000:0.0:1788865032.022898:0:15714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528876160 00000100:00100000:0.0:1788865032.022974:0:15714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:0.0:1788865032.022985:0:15714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14989055-e60f-465d-a477-346c1f551105+31:14500:x1875760528876160:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788865032.023137:0:15714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14989055-e60f-465d-a477-346c1f551105+31:14500:x1875760528876160:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 154us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865032.023145:0:15714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:3.0:1788865032.026560:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865032.026786:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528876288 00000100:00100000:2.0:1788865032.026796:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528876288 00000100:00100000:2.0:1788865032.026843:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:2.0:1788865032.026852:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14989055-e60f-465d-a477-346c1f551105+31:14500:x1875760528876288:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788865032.059018:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:3.0:1788865032.059031:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788865032.059071:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:3.0:1788865032.059079:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:3.0:1788865032.059430:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc063bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546683136:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788865032.059492:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788865032.059669:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546683136 00000100:00100000:2.0:1788865032.059678:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546683136 00000100:00100000:2.0:1788865032.059750:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788865032.059761:0:14985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875760546683136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788865032.059925:0:14985:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788865032.059929:0:14985:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788865032.059932:0:14985:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788865032.059933:0:14985:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788865031 -> 1788865031 00002000:00010000:2.0:1788865032.059935:0:14985:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788865032.059979:0:14985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1875760546683136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 221us (487us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788865032.059987:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1788865032.060106:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fdcc063bb80/2, rc 0, transno 8589934595 00000100:00100000:2.0:1788865032.060113:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc063bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875760546683136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788865032.060361:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14989055-e60f-465d-a477-346c1f551105+14:14500:x1875760528876288:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 33507us (33817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788865032.060370:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:1.0:1788865032.063348:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788865032.063477:0:16044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528876416 00000100:00100000:3.0:1788865032.063486:0:16044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528876416 00000100:00100000:3.0:1788865032.063582:0:16044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:3.0:1788865032.063593:0:16044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14989055-e60f-465d-a477-346c1f551105+7:2359:x1875760528876416:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788865032.063693:0:16044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14989055-e60f-465d-a477-346c1f551105+7:2359:x1875760528876416:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 103us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865032.063701:0:16044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:2.0:1788865032.065969:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865032.066061:0:15714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528876672 00000100:00100000:0.0:1788865032.066070:0:15714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528876672 00000100:00100000:3.0:1788865032.066270:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:3.0:1788865032.066282:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14989055-e60f-465d-a477-346c1f551105+14:14500:x1875760528876672:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788865032.066331:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788865032.066357:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c6c00/0xf8c13e2d0e95a825 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760019 expref: 14 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.066376:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fdc83b0df00) 00010000:00010000:3.0:1788865032.066381:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788865032.066409:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e95a833 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.066423:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e95a833 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.066446:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e95a833 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788865032.066748:0:14303:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000084f76631 reply state 0000000025768b78 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e95a833 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865032.066758:0:14303:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788865032.066862:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14989055-e60f-465d-a477-346c1f551105+15:14500:x1875760528876672:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 580us (896us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788865032.066869:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00010000:00010000:3.0:1788865032.071902:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e95a833 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.071931:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e95a833 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.071939:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e95a833 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.071946:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213ea00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788865032.071951:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e95a833 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.071958:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e95a833 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.071975:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fdc83b0df00) 00010000:00010000:3.0:1788865032.071978:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788865032.071983:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e95a833 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.072007:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213ea00/0xf8c13e2d0e95a833 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788865032.075258:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865032.075361:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528876800 00000100:00100000:1.0:1788865032.075371:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528876800 00000100:00100000:1.0:1788865032.075464:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:1.0:1788865032.075474:0:14985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14989055-e60f-465d-a477-346c1f551105+7:14500:x1875760528876800:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788865032.075492:0:14985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788865032.075520:0:14985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4448e64/0xf8c13e2d0e95a83a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c2384dba9760027 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.075550:0:14985:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062da7701/0xf8c13e2d0e95a82c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760020 expref: 8 pid: 16044 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.075566:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788865032.075570:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788865032.075575:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4448e64/0xf8c13e2d0e95a83a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760027 expref: 8 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.075624:0:14985:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062da7701/0xf8c13e2d0e95a82c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760020 expref: 8 pid: 16044 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.075638:0:14985:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062da7701/0xf8c13e2d0e95a82c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760020 expref: 8 pid: 16044 timeout: 555 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788865032.075653:0:14985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0556a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14985:1875760546683264:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788865032.075761:0:14985:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca1fd0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788865032.078559:0:14985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0556a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14985:1875760546683264:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788865032.078596:0:14985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f4448e64/0xf8c13e2d0e95a83a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760027 expref: 8 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.078619:0:14985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fdcafc74200, rc 0) 00000100:00100000:2.0:1788865032.078676:0:14985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14989055-e60f-465d-a477-346c1f551105+8:14500:x1875760528876800:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 3203us (3428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865032.078684:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:2.0:1788865032.082224:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788865032.082385:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528876928 00000100:00100000:3.0:1788865032.082395:0:14287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528876928 00010000:00010000:3.0:1788865032.082434:0:14287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062da7701/0xf8c13e2d0e95a82c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760020 expref: 8 pid: 16044 timeout: 555 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865032.082479:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1788865032.082488:0:14287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdb81926300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14989055-e60f-465d-a477-346c1f551105+8:2357:x1875760528876928:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788865032.082513:0:14287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788865032.082537:0:14287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062da7701/0xf8c13e2d0e95a82c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760020 expref: 8 pid: 16044 timeout: 555 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.082560:0:14287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062da7701/0xf8c13e2d0e95a82c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760020 expref: 8 pid: 16044 timeout: 555 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.082584:0:14287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062da7701/0xf8c13e2d0e95a82c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760020 expref: 8 pid: 16044 timeout: 555 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.082601:0:14287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788865032.082605:0:14287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788865032.082611:0:14287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4448e64/0xf8c13e2d0e95a83a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760027 expref: 7 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.082640:0:14287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4448e64/0xf8c13e2d0e95a83a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760027 expref: 7 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.082679:0:14287:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f4448e64/0xf8c13e2d0e95a83a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760027 expref: 7 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865032.082694:0:14287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14287:1875760546683392:192.168.203.13@tcp:105: 00000100:00100000:3.0:1788865032.082815:0:14287:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc86022a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788865032.086983:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865032.087372:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528877056 00000100:00100000:2.0:1788865032.087382:0:14986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528877056 00000100:00100000:2.0:1788865032.087444:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:2.0:1788865032.087456:0:14986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0554e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14989055-e60f-465d-a477-346c1f551105+8:2359:x1875760528877056:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788865032.087681:0:14986:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788865032.087685:0:14986:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788865031 00002000:00010000:2.0:1788865032.087688:0:14986:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788865030 00002000:00010000:2.0:1788865032.087690:0:14986:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788865031 -> 1788865031 00002000:00010000:2.0:1788865032.087692:0:14986:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788865032.087775:0:14986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0554e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14989055-e60f-465d-a477-346c1f551105+9:2359:x1875760528877056:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 321us (800us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788865032.087783:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:3.0:1788865032.089431:0:14287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14287:1875760546683392:192.168.203.13@tcp:105: 00010000:00010000:3.0:1788865032.089455:0:14287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788865032.089658:0:14287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdb81926300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14989055-e60f-465d-a477-346c1f551105+8:2357:x1875760528876928:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 7169us (7441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865032.089667:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:1.0:1788865032.100534:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788865032.100638:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528877184 00000100:00100000:3.0:1788865032.100648:0:14983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528877184 00000100:00100000:3.0:1788865032.100750:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:3.0:1788865032.100760:0:14983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0557b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14989055-e60f-465d-a477-346c1f551105+8:2358:x1875760528877184:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788865032.100800:0:14983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cd6d962b/0xf8c13e2d0e95a841 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.100820:0:14983:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4448e64/0xf8c13e2d0e95a83a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760027 expref: 8 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.100829:0:14983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788865032.100847:0:14983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788865032.100852:0:14983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6d962b/0xf8c13e2d0e95a841 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.100886:0:14983:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f4448e64/0xf8c13e2d0e95a83a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760027 expref: 8 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.100900:0:14983:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f4448e64/0xf8c13e2d0e95a83a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760027 expref: 8 pid: 14985 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865032.100926:0:14983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14983:1875760546683520:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788865032.100998:0:14983:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc86022a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788865032.109460:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865032.109690:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528877312 00000100:00100000:2.0:1788865032.109700:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528877312 00010000:00010000:2.0:1788865032.109769:0:14286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f4448e64/0xf8c13e2d0e95a83a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760027 expref: 9 pid: 14985 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788865032.109801:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:2.0:1788865032.109810:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0555880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14989055-e60f-465d-a477-346c1f551105+9:2359:x1875760528877312:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788865032.109825:0:14286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788865032.109846:0:14286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f4448e64/0xf8c13e2d0e95a83a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760027 expref: 9 pid: 14985 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.109859:0:14286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f4448e64/0xf8c13e2d0e95a83a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760027 expref: 9 pid: 14985 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.109882:0:14286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788865032.109887:0:14286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788865032.109892:0:14286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd6d962b/0xf8c13e2d0e95a841 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.109922:0:14286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6d962b/0xf8c13e2d0e95a841 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.109942:0:14286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788865032.109996:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0555880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14989055-e60f-465d-a477-346c1f551105+9:2359:x1875760528877312:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 186us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865032.110003:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00010000:00010000:3.0:1788865032.111746:0:14983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4448e64/0xf8c13e2d0e95a83a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760027 expref: 8 pid: 14985 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865032.111768:0:14983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14983:1875760546683520:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788865032.111790:0:14983:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cd6d962b/0xf8c13e2d0e95a841 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.112132:0:14983:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cd6d962b/0xf8c13e2d0e95a841 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.112144:0:14983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd6d962b/0xf8c13e2d0e95a841 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.112177:0:14983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cd6d962b/0xf8c13e2d0e95a841 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.112186:0:14983:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6d962b/0xf8c13e2d0e95a841 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.112194:0:14983:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd6d962b/0xf8c13e2d0e95a841 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.112201:0:14983:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213ea00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:2.0:1788865032.112205:0:14983:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd6d962b/0xf8c13e2d0e95a841 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.112234:0:14983:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd6d962b/0xf8c13e2d0e95a841 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.112253:0:14983:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd6d962b/0xf8c13e2d0e95a841 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.112260:0:14983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd6d962b/0xf8c13e2d0e95a841 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788865032.112396:0:14983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0557b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14989055-e60f-465d-a477-346c1f551105+7:2358:x1875760528877184:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 11636us (11870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865032.112405:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:1.0:1788865032.114932:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865032.115008:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528877568 00000100:00100000:0.0:1788865032.115025:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528877568 00000100:00100000:0.0:1788865032.115119:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:0.0:1788865032.115130:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14989055-e60f-465d-a477-346c1f551105+14:14500:x1875760528877568:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788865032.115220:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7200/0xf8c13e2d0e95a848 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865032.115237:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7200/0xf8c13e2d0e95a848 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865032.115249:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7200/0xf8c13e2d0e95a848 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865032.115466:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7600/0xf8c13e2d0e95a84f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865032.115478:0:14301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a817 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760012 expref: 15 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865032.115486:0:14301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7600/0xf8c13e2d0e95a84f lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865032.115518:0:14301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a817 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760012 expref: 15 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865032.115532:0:14301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a817 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760012 expref: 15 pid: 14301 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788865032.115545:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc85a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14301:1875760546683648:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788865032.115632:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc85e95480 going to sleep for 11 seconds 00000100:00100000:1.0:1788865032.119101:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788865032.119247:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528877696 00000100:00100000:3.0:1788865032.119256:0:14287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528877696 00010000:00010000:3.0:1788865032.119312:0:14287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a817 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760012 expref: 16 pid: 14301 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865032.119353:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:3.0:1788865032.119363:0:14287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0554700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14989055-e60f-465d-a477-346c1f551105+16:2358:x1875760528877696:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788865032.119386:0:14287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788865032.119393:0:14287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a817 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760012 expref: 16 pid: 14301 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.119406:0:14287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a817 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760012 expref: 16 pid: 14301 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.119425:0:14287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fdc83b0df00) 00010000:00010000:3.0:1788865032.119430:0:14287:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7600/0xf8c13e2d0e95a84f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.119439:0:14287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7600/0xf8c13e2d0e95a84f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.119447:0:14287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7600/0xf8c13e2d0e95a84f lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.119466:0:14287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788865032.119518:0:14287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0554700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14989055-e60f-465d-a477-346c1f551105+16:2358:x1875760528877696:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 158us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788865032.119527:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00010000:00010000:0.0:1788865032.120262:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7c00/0xf8c13e2d0e95a817 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x5c2384dba9760012 expref: 15 pid: 14301 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788865032.120293:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc85a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14301:1875760546683648:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788865032.120313:0:14301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7600/0xf8c13e2d0e95a84f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865032.120321:0:14301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7600/0xf8c13e2d0e95a84f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865032.120327:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7600/0xf8c13e2d0e95a84f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788865032.120504:0:14301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1788865032.120651:0:14301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1788865032.120695:0:14301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1788865032.121064:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbc85a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14301:1875760546683776:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788865032.121172:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788865032.121203:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdca8d28600 going to sleep for 11 seconds 00000100:00100000:1.0:1788865032.121444:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546683776 00000100:00100000:1.0:1788865032.121450:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546683776 00000100:00100000:1.0:1788865032.121494:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788865032.121503:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14301:x1875760546683776:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788865032.121604:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14301:x1875760546683776:12345-0@lo:1000:mdt00_001.0 Request processed in 102us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865032.121612:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788865032.121695:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbc85a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14301:1875760546683776:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788865032.122390:0:14301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1788865032.122457:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14301:1875760546683904:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788865032.122497:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788865032.122517:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc85e95480 going to sleep for 11 seconds 00000100:00100000:1.0:1788865032.123076:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546683904 00000100:00100000:1.0:1788865032.123082:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546683904 00000100:00100000:1.0:1788865032.123114:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788865032.123122:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbfee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14301:x1875760546683904:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788865032.123306:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbfee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14301:x1875760546683904:12345-0@lo:1000:mdt00_001.0 Request processed in 184us (807us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788865032.123314:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788865032.124613:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14301:1875760546683904:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788865032.124657:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7600/0xf8c13e2d0e95a84f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.124677:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7600/0xf8c13e2d0e95a84f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.124684:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7600/0xf8c13e2d0e95a84f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.124690:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcbd0c7600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788865032.124694:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7600/0xf8c13e2d0e95a84f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.124732:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7600/0xf8c13e2d0e95a84f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.124749:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fdc83b0df00) 00010000:00010000:3.0:1788865032.124752:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788865032.124757:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7600/0xf8c13e2d0e95a84f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.124763:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7600/0xf8c13e2d0e95a84f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.124796:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a7a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.124802:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a7a7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.124809:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a7a7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.124814:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788865032.124822:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a7a7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.124838:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a7a7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.124848:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:3.0:1788865032.124850:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788865032.124857:0:14301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384400/0xf8c13e2d0e95a7ae lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fff6 expref: 18 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.124868:0:14301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384400/0xf8c13e2d0e95a7ae lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fff6 expref: 18 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.124878:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384400/0xf8c13e2d0e95a7ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fff6 expref: 18 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.125250:0:14301:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384400/0xf8c13e2d0e95a7ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x5c2384dba975fff6 expref: 18 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865032.125266:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcbfee0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14301:1875760546684032:192.168.203.13@tcp:105: 00000100:00100000:3.0:1788865032.125334:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fdc85e95600 going to sleep for 11 seconds 00000100:00100000:1.0:1788865032.132162:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788865032.132483:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcbfee0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14301:1875760546684032:192.168.203.13@tcp:105: 00010000:00010000:3.0:1788865032.132511:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a7a7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.132521:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5384600/0xf8c13e2d0e95a7a7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.132586:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a856 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.132599:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a856 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.132611:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a856 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.132622:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a856 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.132628:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a856 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.132634:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a856 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.132640:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213fc00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788865032.132643:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a856 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.132649:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a856 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.132660:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:3.0:1788865032.132663:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788865032.132667:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a856 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.132673:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdb8213fc00/0xf8c13e2d0e95a856 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.132693:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7200/0xf8c13e2d0e95a848 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.132699:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7200/0xf8c13e2d0e95a848 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.132726:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7200/0xf8c13e2d0e95a848 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.132732:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcbd0c7200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1788865032.132735:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7200/0xf8c13e2d0e95a848 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.132741:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7200/0xf8c13e2d0e95a848 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.132749:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fdc9124ef00) 00010000:00010000:3.0:1788865032.132752:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788865032.132755:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7200/0xf8c13e2d0e95a848 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.132761:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcbd0c7200/0xf8c13e2d0e95a848 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865032.133096:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14989055-e60f-465d-a477-346c1f551105+18:14500:x1875760528877568:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 17965us (18167us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1788865032.133106:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000020:00080000:3.0:1788865032.133112:0:14301:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788865032.133400:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528877824 00000100:00100000:2.0:1788865032.133408:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528877824 00000100:00100000:2.0:1788865032.133456:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:2.0:1788865032.133465:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdca1aaa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14989055-e60f-465d-a477-346c1f551105+18:14499:x1875760528877824:12345-192.168.203.13@tcp:49:dd.0 00000100:00100000:2.0:1788865032.133567:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdca1aaa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14989055-e60f-465d-a477-346c1f551105+18:14499:x1875760528877824:12345-192.168.203.13@tcp:49:dd.0 Request processed in 103us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788865032.133573:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000040:00080000:1.0:1788865032.134008:0:14333:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788865032.134025:0:14333:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788865032.134068:0:14333:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788865032.134074:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788865032.140945:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865032.141435:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528878080 00000100:00100000:2.0:1788865032.141445:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528878080 00000100:00100000:2.0:1788865032.141497:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:2.0:1788865032.141507:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14989055-e60f-465d-a477-346c1f551105+18:14500:x1875760528878080:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788865032.142413:0:14305:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788865032.142527:0:14305:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788865032.142569:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a85d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.142586:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a85d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.142598:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a85d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.142608:0:14305:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a85d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.142615:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a85d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.142621:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a85d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.142638:0:14305:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788865032.142741:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14989055-e60f-465d-a477-346c1f551105+20:14500:x1875760528878080:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 1232us (1803us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788865032.142749:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000020:00080000:2.0:1788865032.142754:0:14305:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788865032.143995:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788865032.144006:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a85d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865032.144025:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385400 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:0.0:1788865032.144030:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a85d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865032.144039:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a85d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865032.144063:0:14289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fdc83b0df00) 00010000:00010000:0.0:1788865032.144079:0:14289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788865032.144084:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a85d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865032.144091:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fdcb5385400/0xf8c13e2d0e95a85d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788865032.144105:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865032.144106:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865032.144108:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788865032.376286:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865032.376328:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788865032.376365:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865032.377457:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528878208 00000100:00100000:1.0:1788865032.377469:0:14990:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528878208 00000100:00100000:1.0:1788865032.377518:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528878336 00000100:00100000:1.0:1788865032.377521:0:14990:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528878336 00000100:00100000:1.0:1788865032.377534:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528878464 00000100:00100000:1.0:1788865032.377536:0:14990:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528878464 00000100:00100000:1.0:1788865032.377554:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:1.0:1788865032.377563:0:14990:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14989055-e60f-465d-a477-346c1f551105+9:2358:x1875760528878208:12345-192.168.203.13@tcp:4:dd.0 00002000:00010000:1.0:1788865032.377609:0:14990:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9fea07, atime: 0x6a9fea06, ctime: 0x6a9fea07, blocks: 0x1 00010000:00010000:1.0:1788865032.377618:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a864 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.377633:0:14990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1788865032.377637:0:14990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788865032.377644:0:14990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a864 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.377657:0:14990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a864 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788865032.466739:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:1.0:1788865032.466756:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:1.0:1788865032.466764:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:1.0:1788865032.466813:0:14990:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1788865032.466817:0:14990:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1788865032.466832:0:14990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a864 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.466845:0:14990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a864 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.466855:0:14990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a864 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.466862:0:14990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75e00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865032.466866:0:14990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a864 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.466875:0:14990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a864 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.466894:0:14990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a864 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.466901:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a864 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788865032.467732:0:14990:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14989055-e60f-465d-a477-346c1f551105+7:2358:x1875760528878208:12345-192.168.203.13@tcp:4:dd.0 Request processed in 90138us (91423us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788865032.467741:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:1.0:1788865032.467774:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:1.0:1788865032.467784:0:14990:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc85b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14989055-e60f-465d-a477-346c1f551105+6:2359:x1875760528878336:12345-192.168.203.13@tcp:4:dd.0 00002000:00010000:1.0:1788865032.467823:0:14990:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 1048576, mtime: 0x6a9fea07, atime: 0x6a9fea06, ctime: 0x0, blocks: 0x803 00010000:00010000:1.0:1788865032.467830:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7113f0f/0xf8c13e2d0e95a86b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.467842:0:14990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1788865032.467847:0:14990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788865032.467853:0:14990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7113f0f/0xf8c13e2d0e95a86b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.467865:0:14990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7113f0f/0xf8c13e2d0e95a86b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788865032.542836:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:3.0:1788865032.543066:0:14990:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:3.0:1788865032.543071:0:14990:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:3.0:1788865032.543100:0:14990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7113f0f/0xf8c13e2d0e95a86b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.543113:0:14990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7113f0f/0xf8c13e2d0e95a86b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.543123:0:14990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7113f0f/0xf8c13e2d0e95a86b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.543130:0:14990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc74e00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:3.0:1788865032.543135:0:14990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7113f0f/0xf8c13e2d0e95a86b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.543145:0:14990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7113f0f/0xf8c13e2d0e95a86b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.543164:0:14990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7113f0f/0xf8c13e2d0e95a86b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.543173:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7113f0f/0xf8c13e2d0e95a86b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865032.543284:0:14990:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc85b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14989055-e60f-465d-a477-346c1f551105+6:2359:x1875760528878336:12345-192.168.203.13@tcp:4:dd.0 Request processed in 75498us (166951us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788865032.543313:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:3.0:1788865032.543356:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:3.0:1788865032.543368:0:14990:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc85bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14989055-e60f-465d-a477-346c1f551105+5:2358:x1875760528878464:12345-192.168.203.13@tcp:4:dd.0 00002000:00010000:3.0:1788865032.543415:0:14990:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6a9fea07, atime: 0x6a9fea06, ctime: 0x0, blocks: 0x1007 00010000:00010000:3.0:1788865032.543421:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041fe6fd4/0xf8c13e2d0e95a872 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.543433:0:14990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=455s v=(0 0) 00010000:00010000:3.0:1788865032.543438:0:14990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788865032.543444:0:14990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041fe6fd4/0xf8c13e2d0e95a872 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.543456:0:14990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041fe6fd4/0xf8c13e2d0e95a872 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.581420:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788865032.604839:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1788865032.605063:0:14990:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:2.0:1788865032.605069:0:14990:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1788865032.605099:0:14990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041fe6fd4/0xf8c13e2d0e95a872 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.605149:0:14990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041fe6fd4/0xf8c13e2d0e95a872 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.605179:0:14990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041fe6fd4/0xf8c13e2d0e95a872 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.605187:0:14990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213fc00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:2.0:1788865032.605192:0:14990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041fe6fd4/0xf8c13e2d0e95a872 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.605358:0:14990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041fe6fd4/0xf8c13e2d0e95a872 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.605390:0:14990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041fe6fd4/0xf8c13e2d0e95a872 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.605398:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041fe6fd4/0xf8c13e2d0e95a872 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788865032.605542:0:14990:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc85bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14989055-e60f-465d-a477-346c1f551105+5:2358:x1875760528878464:12345-192.168.203.13@tcp:4:dd.0 Request processed in 62173us (229171us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788865032.605655:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:2.0:1788865032.615590:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865032.615633:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865032.615697:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788865032.615746:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528878592 00000100:00100000:2.0:1788865032.615755:0:14991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528878592 00000100:00100000:2.0:1788865032.615796:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528878720 00000100:00100000:2.0:1788865032.615798:0:14991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528878720 00000100:00100000:2.0:1788865032.615825:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528878848 00000100:00100000:2.0:1788865032.615828:0:14991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528878848 00000100:00100000:2.0:1788865032.615842:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:2.0:1788865032.615851:0:14991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcafca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14989055-e60f-465d-a477-346c1f551105+7:2359:x1875760528878592:12345-192.168.203.13@tcp:4:dd.0 00002000:00010000:2.0:1788865032.615896:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a9fea07, atime: 0x6a9fea06, ctime: 0x0, blocks: 0x1807 00010000:00010000:2.0:1788865032.615905:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000601dbfb2/0xf8c13e2d0e95a879 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.615920:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=455s v=(0 0) 00010000:00010000:2.0:1788865032.615924:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788865032.615931:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000601dbfb2/0xf8c13e2d0e95a879 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.615944:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000601dbfb2/0xf8c13e2d0e95a879 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788865032.617295:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865032.617325:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788865032.617341:0:14989:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788865032.617349:0:14989:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788865032.617698:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528879104 00000100:00100000:1.0:1788865032.617726:0:14989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528879104 00000100:00100000:1.0:1788865032.617774:0:14989:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788865032.617780:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760528878976 00000100:00100000:1.0:1788865032.617783:0:14989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760528878976 00000100:00100000:0.0:1788865032.619264:0:16528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:2.0:1788865032.619981:0:16528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdc86ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14989055-e60f-465d-a477-346c1f551105+10:2358:x1875760528878720:12345-192.168.203.13@tcp:4:dd.0 00010000:00010000:2.0:1788865032.621179:0:16528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db125696/0xf8c13e2d0e95a880 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.621208:0:16528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788865032.621213:0:16528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788865032.621219:0:16528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db125696/0xf8c13e2d0e95a880 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.621235:0:16528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db125696/0xf8c13e2d0e95a880 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788865032.692401:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:1.0:1788865032.702278:0:14991:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:1.0:1788865032.702288:0:14991:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788865031 -> 1788865032 00002000:00010000:1.0:1788865032.702291:0:14991:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788865032 00002000:00010000:1.0:1788865032.702293:0:14991:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:1.0:1788865032.702307:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000601dbfb2/0xf8c13e2d0e95a879 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.702320:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000601dbfb2/0xf8c13e2d0e95a879 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.702329:0:14991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000601dbfb2/0xf8c13e2d0e95a879 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.702335:0:14991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5385400 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865032.702340:0:14991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000601dbfb2/0xf8c13e2d0e95a879 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.702349:0:14991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000601dbfb2/0xf8c13e2d0e95a879 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.702367:0:14991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000601dbfb2/0xf8c13e2d0e95a879 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.702375:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000601dbfb2/0xf8c13e2d0e95a879 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788865032.702490:0:14991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcafca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14989055-e60f-465d-a477-346c1f551105+12:2359:x1875760528878592:12345-192.168.203.13@tcp:4:dd.0 Request processed in 86634us (86904us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788865032.702500:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:1.0:1788865032.702542:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:1.0:1788865032.702681:0:14991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0638000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14989055-e60f-465d-a477-346c1f551105+11:2358:x1875760528878848:12345-192.168.203.13@tcp:4:dd.0 00010000:00010000:1.0:1788865032.702823:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a887 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.702847:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788865032.702851:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788865032.702857:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a887 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.702870:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a887 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788865032.748577:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:3.0:1788865032.750981:0:16528:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00010000:00010000:3.0:1788865032.751004:0:16528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db125696/0xf8c13e2d0e95a880 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.751018:0:16528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db125696/0xf8c13e2d0e95a880 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.751028:0:16528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db125696/0xf8c13e2d0e95a880 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.751035:0:16528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384600 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:3.0:1788865032.751040:0:16528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db125696/0xf8c13e2d0e95a880 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.751078:0:16528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db125696/0xf8c13e2d0e95a880 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.751098:0:16528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db125696/0xf8c13e2d0e95a880 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.751106:0:16528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db125696/0xf8c13e2d0e95a880 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865032.751197:0:16528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdc86ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14989055-e60f-465d-a477-346c1f551105+11:2358:x1875760528878720:12345-192.168.203.13@tcp:4:dd.0 Request processed in 131914us (135557us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1788865032.751336:0:16528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:3.0:1788865032.751375:0:16528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:3.0:1788865032.751387:0:16528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0555c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14989055-e60f-465d-a477-346c1f551105+10:2359:x1875760528879104:12345-192.168.203.13@tcp:4:dd.0 00010000:00010000:3.0:1788865032.751419:0:16528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050ddda2a/0xf8c13e2d0e95a88e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.751432:0:16528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788865032.751436:0:16528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788865032.751442:0:16528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050ddda2a/0xf8c13e2d0e95a88e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.751454:0:16528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050ddda2a/0xf8c13e2d0e95a88e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788865032.794077:0:14991:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:2.0:1788865032.794086:0:14991:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:2.0:1788865032.794101:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a887 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.794114:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a887 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.794124:0:14991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a887 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.794131:0:14991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcafc75e00 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:2.0:1788865032.794136:0:14991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a887 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.794145:0:14991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a887 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.794164:0:14991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a887 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.794172:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c7956fa/0xf8c13e2d0e95a887 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788865032.794406:0:14991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0638000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14989055-e60f-465d-a477-346c1f551105+12:2358:x1875760528878848:12345-192.168.203.13@tcp:4:dd.0 Request processed in 91725us (178702us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788865032.794416:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:2.0:1788865032.794447:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1788865032.794458:0:14991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcc0557480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14989055-e60f-465d-a477-346c1f551105+11:2359:x1875760528878976:12345-192.168.203.13@tcp:4:dd.0 00010000:00010000:2.0:1788865032.794488:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db125696/0xf8c13e2d0e95a895 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.794501:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788865032.794505:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788865032.794511:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db125696/0xf8c13e2d0e95a895 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788865032.794523:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db125696/0xf8c13e2d0e95a895 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788865032.798058:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00000001:00080000:2.0:1788865032.841542:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:3.0:1788865032.841807:0:16528:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1788865032.841823:0:16528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050ddda2a/0xf8c13e2d0e95a88e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.842054:0:16528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050ddda2a/0xf8c13e2d0e95a88e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.842065:0:16528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050ddda2a/0xf8c13e2d0e95a88e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.842073:0:16528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdb8213f200 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:3.0:1788865032.842078:0:16528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050ddda2a/0xf8c13e2d0e95a88e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.842087:0:16528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050ddda2a/0xf8c13e2d0e95a88e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.842106:0:16528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050ddda2a/0xf8c13e2d0e95a88e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788865032.842114:0:16528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050ddda2a/0xf8c13e2d0e95a88e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788865032.842198:0:16528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0555c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:14989055-e60f-465d-a477-346c1f551105+9:2359:x1875760528879104:12345-192.168.203.13@tcp:4:dd.0 Request processed in 90811us (224906us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788865032.842220:0:16528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00002000:00010000:1.0:1788865032.872679:0:14991:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1788865032.872701:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db125696/0xf8c13e2d0e95a895 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.872738:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db125696/0xf8c13e2d0e95a895 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.872747:0:14991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db125696/0xf8c13e2d0e95a895 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.872771:0:14991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fdcb5384600 already unused, calling callback (ffffffffc17c08b0) 00010000:00010000:1.0:1788865032.872776:0:14991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db125696/0xf8c13e2d0e95a895 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.872785:0:14991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db125696/0xf8c13e2d0e95a895 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.872804:0:14991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db125696/0xf8c13e2d0e95a895 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788865032.872811:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db125696/0xf8c13e2d0e95a895 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788865032.872915:0:14991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcc0557480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14989055-e60f-465d-a477-346c1f551105+7:2359:x1875760528878976:12345-192.168.203.13@tcp:4:dd.0 Request processed in 78455us (255583us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788865032.872924:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000001:00080000:2.0:1788865032.874266:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:0.0:1788865033.605168:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788865034.628825:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788865034.637182:0:16566:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1788865035.589101:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788865035.589129:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fdcc0557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546684160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788865035.589201:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788865035.589484:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875760546684160 00000100:00100000:1.0:1788865035.589492:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875760546684160 00000100:00100000:1.0:1788865035.589564:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788865035.589573:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fdcbc858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546684160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788865035.589608:0:14987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788865035.589653:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fdcbc858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875760546684160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788865035.589661:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788865035.589823:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788865035.589871:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fdcc0557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875760546684160:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788865035.653106:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788865036.232591:0:14333:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788865036.232601:0:14333:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788865036.232635:0:14333:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788865036.232641:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 Debug log: 28909 lines, 28909 kept, 0 dropped, 0 bad.